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ABSTRACT 


This study was designed to examine (1) the 
methods used to evaluate instructors, (2) the purposes 
@fgevaluaking wnstuuctors, candg@ (3) the orncerravliot 
instructor evaluation employed when evaluating 
instructors for (a) competence, and (b) promotion to 
an administrative position, in community colleges in 
Western Canada. 

Two instruments were sent to thirty community 
colleges in Western Canada. The first one was sent 
to the chief executive officer of each college to 
determine the number of people involved in evaluating 
instructors as well as the methods and purposes of 
evaluation (87% return). The second instrument was 
sent to the evaluators of instructors in each college 
(80% return). It consisted of nine personal and 
professional data items and two thirty-item question- 
naires--one for each of the two evaluative situations~-- 
made up of ten each of Mitzel's categories of process, 
product, and presage criteria. Respondents scored 
each criteria on a four point scale. Space was 
provided on the instrument for evaluators to aks 
additional criteria which they would employ in each 


of the two evaluative situations, and also to make 
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any comments on the study. 

Statistical procedures used to analyze the 
data included a frequency count of the use made of 
different methods of evaluating instructors; a cate- 
gourzatrom-ofethe purposes of evaluating: instructors 
and a ranking of the categories; a frequency count to 
placemcutteria iim rankiorder for both evaluative 
situations to determine if a common body of criteria 
wasmuseds im eiutherrior: both of, the: situations'’sy a 
factor analysis to see if criteria tended to cluster 
inmiMirezed isweateqories) of process, product and 
presage criteria; chi square tests to isolate signif- 
icant differences between categories of six personal 
and professional variables and evaluators’ uses of 
specific criteria; a classification of the additional 
criteria used by evaluators according to a scheme 
devised by Barr; and a classification of respondents’ 
comments on the study. 

Analysis of the data revealed that the most 
commonly used methods of evaluating instructors were 
student evaluation, classroom observation, and team 
evaluation. The major purpose of evaluating instructors 
was to improve instruction. It was also found that a 
common body of evaluative criteria was employed in 
both situations. Process criteria were stressed when 
evaluating instructor competence and presage criteria 


were stressed when rating instructors for administrative 
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promotion. Thirty significant relationships were found 
to exist between the personal and professional variables 
and the use of certain criteria. Over five hundred 
additional criteria used in the two evaluative situations 
were listed by the evaluators. Analysispof these re- 
vealed that a common body of criteria was used in each 

of the evaluative situations. 

This study would seem to show the lack of 
emphasasoont product; criteria ,@the possibility of 
constructing evaluation instruments based on the 
commonly used criteria which were identified, the 
timeliness of pursuing new approaches to evaluating 
instructors, and the need for increased useage Of direct 


information in evaluating instructors. 
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Chapter 1 
STATEMENT OF THE PROBLEM AND ITS SIGNIFICANCE 
INTRODUCTION 


Of the many problems facing the community 
college, perhaps none is more crucial than that of 
providing meaningful instruction. Since individual 
instructors remain the key to implementing an effective 
instructional program, the need for assessing their 
competencies is obvious. It has been claimed that a 
community college is a unique institution of higher 
education. One facet of its uniqueness is the emphasis 
placed on teaching rather than research. If community 
colleges hope to fulfill this promise of providing 
good instruction, evaluation of their instructors is of 
prime importance. Evaluation of instructors, both those 
on probation and those with tenure, is a prerequisite 
for establishing and maintaining the reputation of a 
"teaching" college (NFA, 1970). 

Presently, little is done by Canadian teacher- 
training institutions to prepare instructors expressly 
for teaching in community colleges. Instructors differ 
widely in academic qualifications and teaching experience. 
The varied ages, skills, and interests of community 
college students necessitate adjustments in the teaching 
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techniques which will effectively translate curriculum 
content into terms meaningful to students. In view of 
these factors, assessment of the competencies of its 
instructional staff becomes a crucial and sometimes 
difficult task for the community college. 

Methods, criteria, and instruments for evaluation 
are legion, but comparative reliability has not been 
determined as yet. Whether evaluation is conducted 
formally or informally, jointly or individually, the 
problem of criteria to be used always exists. 

Previous studies by Moore (1966), Thomas (1969), 
and Rogers (1970), using Mitzel's criteria of process, 
product, and presage, have found that many problems 
concerning criteria exist when principals and inspectors 
evaluate teachers. No studies similar to these have 


been conducted in community colleges in Western Canada. 
STATEMENT OF THE PROBLEM 


Numerous rating forms and check lists are provided 
in community colleges in Western Canada for the purpose BE 
evaluating instructors. No research has been carraea OuL 
to determine the degree of consistency among criteria 
upon which evaluations are based. This study has attempted 
to assess whether there is a common body of criteria used. 

Methods used to evaluate instructors and 
approaches to evaluating the instructional process vary 


among the community colleges in Western Canada. The 
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emphases placed on different methods and purposes of 
snstructor evaluation are changing. This study has 
attempted to determine the major purposes of InsSeEucLoy 
evaluation as well as the principal methods currently 


being used. 


Major Problems 


1. Is there a common body of criteria used in 
evaluating instructors? 

2. What methods are used to evaluate instructors? 

3. What are the purposes of evaluating 


instructors? 


Sub-Problems 

1. Is there a common body of criteria used in 
evaluating instructor competence? 

2. Is there a common body of criteria used in 
evaluating instructors as being worthy of promotion to 
an administrative position? 

3. Is the emphasis placed in certain classes of 
criteria different in the different situations of (2) band 
(2) above? 

4. Is a particular emphasis placed upon certain 
of the categories of process, product, or presage in 
either or both of the situations in (i) ande(2)8aboveyr 

5. What particular criteria are used both most 
often and least often in the two evaluative situations? 


6. Is there any relationship (and if so, what? ) 
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between the evaluative criteria used by evaluators and 
variables such as administrative position, length of 
experience in the position, age, time spent in teaching, 
teaching experience, and professional training? 

7. What criteria, other than those included in 


the instrument, are employed by evaluators? 
IMPORTANCE OF THE STUDY 


The potential merits of the study are as follows: 

1. It should provide a re-examination of the 
complexity of the task of instructor evaluation, perhaps 
enabling evaluators to see their own practices in the 
light of what their colleagues are doing. 

2. It should isolate criteria commonly used by 
evaluators of instructors in community colleges a 
Western Canada; this information should be of some value 
to instructors, administrators, and governing boards. 

3. It should help to focus attention on the 
variability and subjectivity of evaluation processes, 
perhaps resulting in an effort to increase the objectivity 
of instructor evaluation through the use of researched 
criteria which are both relevant and reliable. 

4. The study closely approximates that of Rogers 
(1970) carried out in Alberta. Rogers' study was based 
to some extent on theses by Thomas (1969) and Moore 
(1966). Findings of the present study should therefore 


either support or negate their findings. 
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BACKGROUND TO THE STUDY 


It has been suggested that compared with other 
institutions of higher education community colleges 
stand in a much better position to make advances in the 
evaluation of teaching (Lee, 1967). New teachers and 
teachers from high schools, universities, and industry 
represent a group who either have established no tra- 
ditional patterns of instruction or who may be willing 
to change their traditional patterns. The opportunity 
exists for improving classroom teaching and instructional 
methods through constructive evaluation. An awareness 
of what criteria are being used to evaluate instructors 
as well as an awareness of the current methods and purposes 
of instructor evaluation should provide a basis for 


further advancement in evaluation. 
DEFINITION OF SIGNIFICANT TERMS 


Evaluation 

Evaluation is an assessment by measurement, 
rating, Or ranking of teacher, effectiveness and competence 
involving value judgments based on observations. 
Evaluation may be formative (for the purpose of promoting 
the professional growth and development of the teacher ) 
Or summative (for the purpose of official reporting of 
the effectiveness of the teacher which may lead to a 
decision regarding the acceptability of teacher 


performance. ) 
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Teacher Effectiveness 





This term refers to the effect of a teacher in 


a given classroom or clinical situation. 


Teacher Competence 


This term refers to the possession of one Or more 


abilities to produce agreed upon educational effects. 


Criteria 

The categories of criteria used in the study are 
Mitzel's categories of process, product, and presage 
criteria (Mitzel, 1960: 1481-86). 

1. Process criteria consist of aspects of teacher 
behavior and student behavior. They involve methods, 
techniques, rapport, climates, and situations involving 
the social interactions of students and teacher. 

2. Product criteria depend upon a set of goals 
toward which teaching is directed, and involve some 
appraisal of changes in student behavior. They relate 
to student gains or growth, both academic and otherwise, 
resulting from the teacher's performance. 

3. Presage criteria involve personal character- 
istics of the teacher, such as his personality attributes, 
his knowledge and achievements, intelligence, status, 
appearance, academic qualifications, and so on. They are 
often referred to as pseudo criteria, for their relevance 
depends upon an assumed or conjectured relationship to 


either process or product criteria. 
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Instructor and Teacher 


These terms are used interchangeably. 





CHAPTER 2 
REVIEW OF THE LITERATURE 
PURPOSES OF EVALUATION 


Lehmann (1961) states that the ultimate purpose 
of evaluating instruction is to improve the quality of 
the learning experiences for students. He cites three 
ways in which improvement may result from evaluation: 
(1) Poor teachers are released and better ones are 
hired. (2) Individual teachers are given opportunity and 
help to improve in their teaching. (3) Students obtain 
more insight into their own role in learning and accept 
more responsibility. for it. 

Egnatoff (1971) cites a recent study of staff 
evaluation procedures in 211 local school systems in the 
United States which identified ten ways in which teacher 
evaluation might be used. Six of the most frequently 
checked purposes were: (1) to stimulate improvement of 
performance, (2) to establish evidence where dismissal 
from service is an issue, (3) to recommend probationary 
teachers for permanent status, (4) to decide on re- 
appointment of probationary teachers, (5) to select 
teachers for promotion, and (6) to decide on reappoint- 


ment of permanent teachers. Egnatoff contends that the 
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primary purpose for establishing a system of staff 
evaluation procedures is twofold: (1) to improve learning 
conditions, and (2) to facilitate administrative decisions. 

Recent studies (Ladd, 1970) stress evaluation of 
instruction as a basis for rewarding excellence in 
teaching. During the 1960's several colleges and 
universities in the United States became aware of the 
need for change in fundamental policies. Among the 
institutions that undertook self-examination studies 
were eleven colleges and universities, including the 
University OL Toronto. There was ready agreement, that 
among the frequent problems encountered was that of 
improving the quality of teaching. Most of the studies 
Focused on the need to make the quality of the professor's 
teaching more readily observable to those who make crucial 
decisions about his status and emoluments. 

The reports were concerned with ways to evaluate 
teaching since, as Ladd suggests, there is general 
recognition that rewards for teacher performance must 
be based on prior evaluation. The most comprehensive 
proposal for evaluation is contained in the Berkeley 
report, which called for a formal dossier on the teaching 
performance of the candidate for tenure. This dossier 
would include (Berkeley, 1966:44): 

. . » all significant tangible evidence, such as 
course materials and plans, syllabi, study guides, 
examinations, and textbooks written by the candidate. 
It should also include written reports by colleagues, 


evaluating the candidate's classroom performance on 
the basis of classroom visitations, and a statement 
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by the candidate describing the rationale of his 
teaching efforts. 


The Toronto report included a generalized 
discussion of teaching and learning and recommended that 
undergraduate teaching be more suitably and obviously 
rewarded. This was backed up by proposals for the use 
of student evaluations of teachers and courses and for 
the inspection, by senior faculty members, of the classes 
of junior teachers. Both of these would be used in 
departmental decisions about faculty promotion and tenure. 

If the purpose of evaluatLwon 1s not tO prove Duct 
to improve, the approach taken in evaluation procedures 
will be radically different from the traditional 
approach. Bruner (1967) states that the most important 
aspect of evaluation is to provide information for 
improvement and the least important is its possible 
detection of ineffectiveness. By stressing positive 
purposes such as recognition of and reward for good 
instruction, improvement of instruction and research, 
facuity fears of evaluation as a threat to career advance- 
ment can be largely alleviated. 

In addition to deciding which teachers to retain 
and/or reward, many institutions of education are under 
pressure to improve instruction and better reward good 
teachers. The public employs professionally trained 
individuals to operate its schools, colleges, and 
universities, and is entitled to demand an accounting 


of their efforts. It is impossible to render a true 
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and complete account without evaluating the teaching 
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Introduction 

Acceptable evaluations must conform to certain 
criteria to warrant being called "acceptable." According 
to Stufflebeam (1971), selection of criteria always 
implies some value system. He lists three types of 
criteria and their characteristics as follows: (1) 
Stilentiti cecriteriappossessing! internal validity ,.external 
Vallidvtyee reliability, andjobjecthivity,.. (2),Practical 
criteria which are essential if the evaluative information 
is to be informative to the receiver. These include, 
relevance, importance, scope, credibility, timeliness, 
and pervasiveness. (3) A prudential criterion of effi- 
ciency, involving requirements such as time, cost, and 
personnel. 

Mitzel (1960) states that criteria should possess 
four basic attributes: (a) relevance, (b) reliability, 
(c) freedom from bias, and (d) practicality. Of these 
four, he denotes relevance, whether direct or indirect, 
as the paramount attribute. 

Lehmann (1961) lists six functions as descriptive 
of the obligations of college and university teaching. He 
Suggests that if one accepts these functions, the 


evaluation of college instruction can proceed by an 
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examination of the extent to which the functions are 
fulfilled. It may also proceed by looking for significant 
behavioral changes in the students. One approach involves 
an examination of the process; the other, an examination 
of the results of instruction. 

Dressel (1967) emphasizes evaluation of class- 
room behavior rather than personality traits. His 
approach to evaluation of college teaching is in line 
with similar proposals made by Tyler, McKeachie, 

Mayhew, Umstattd, and others (Rowland, 1970). They 
disagree over the relative weights to be placed on teacher 
behaviors (means) and student behaviors (ends). 

Teacher effectiveness criteria are frequently 
classified, on the basis of methodology used in obtaining 
the criterion measurements (Morsh and Wilder, 1954; 

Barr, 1948), as either ultimate or proximate (Remmers, 
1952) or as first-order and second-order (Kelly and 
Fiske, 1951). Mitzel (1960) proposed that teaching 
effectiveness criteria be classified according to goal- 
proximity as: (a) product criteria, (b) process 
criteria, or (3) presage criteria. The present study 
is most closely related to the work of Mitzel in 
analyzing the use of process, product, and presage 
criteria for evaluation of instructor competence. 

In 1950, a special committee on the Criteria 
of Teacher Effectiveness, appointed by the American 


Educational Research Association pointed out in their 





SE 







eye enoitonu? add notdw oF: Snake ate to | 
jnsoktinpia 103 paisool yd pgesotd oes ‘yer 9! “+ 
eevioval dosétaqdse 510 ashebdee atts Ak eopnoiio tetolvetied — 
noltshninsxe a5 ,19rnis0 2A+t $2Be00%q ett Fo nokssnimsxe ns 


soi ssusienk 3 sohvsen o3)90) 


-<Besid to nOlitseuvisve sos tdi (vae£) feara1d 






eftH .esisit vii fsnosaieg asi tedasi toivsded moot 
enti aft eit pridossd speiilos Fo no issn tsve od doso1gys. 
- eidosaneM roLivT ad absot 2 sa0qo1g sstimie dtiw . 
yoni? .(O0TCL ,bnsiwoH) evedto bas ~bovsvemy wortyeM 
s9poset nO bensiq od o3 edripiew svitsies Sis se9vo ssipseib 
.(ebas) es1i0iveded tnsbude Gis (steam) exoivetod 
visnesupsit sis srassiio raotevisnet2s sess? 99 2? 


pitiaistdo ni bear po Loon sin: to aiesd ont) no tir ns 


Vs] 
ghee Ll .zebiiw pie faxoM) ednemontas sat notiasbay vai 
,2romnesd) stsmixoig 10 edeokeea ratte S56. (Oper sie - 
bis yifsi) iashi0- bropee hrs 19b10 = jexit es x0 (S20z in 


on idoses feds beedqo1q (0d0L) rosdim EEE Re 
-~is0p of enibadess boitigesia ad siteties aeonevitsente 


229003q (a ) sixediso. jauboxg (8) cl emia 
buted 6 esta, fare ta R 
y a. n9eo%q, sAT 5 a 3 ae bey 4 


rik ae 20 23 + aitt Pd 
a rs 


a » | ue) i Ss 
ave nite Ba hae qDOrct, 2 plait. Co og 
7 


cm io 
ad ee nie ry 
: < ~ a | 





13 
first report that there is only one ultimate criterion 
against which to view a teacher's work and this is the 
effect on the pupils. This suggests that evaluation in 
terms of product alone is supported by the committee. 
Lehmann stated (1961: 354) that, "ultimately, the 
quality of instruction must be found, not in what the 
instructor does, but in what it inspires the students 
to do." Rose (1962) suggests that two other factors 
must be taken into account: (1) the teacher as a person 
with all his particular characteristics, and (2) the 
teaching process itself, the way in which the teacher 
performs to achieve his effects. A combination of these 
two views leads to the kind of general classification 


of criteria adopted by Mitzel. 


Research Linking Process, 
Productj cand Presage 


Flanders (1969) summarizes a set of widely 
separated research studies which provide statistically 
significant support for a particular type of relation- 
ship between process and product (1969: 1426): 

. . it can now be stated with fairly high 
confidence that the percentage of teacher statements 
that make use of ideas and opinions previously 
expressed by pupils is directly related to average 
Class scores on attitude scales of teacher 
attractiveness, liking the class, etc., as well 
as to average achievement scores adjusted for 
initial ability. 

He states that the most theoretically complete research 


involving differential effects of process and product 


variables has been the work of Taba (1964). In his 
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Opinion, the study stands as an excellent model for the 
development of teaching patterns which simultaneously 

are concerned with the cognitive and socioemotional 
consequences of teaching acts when they occur in 
different sequences. He concludes that the preponderance 
of evidence gathered so far would indicate that most 
currently practicing teachers could adopt patterns 

which are more responsive to the ideas and opinions 
expressed by students and realize a gain in both positive 
student attitudes and student achievement. 

In a study by Soar (1966), a set of criterion 
measures of teacher effectiveness was developed by 
factor-analyzing orocess and product measures together. 
These were related to presage measures from the 
Minnesota Multiphase Personality Inventory (MMPI) and 
the National Teacher Examinations (NTE), years of 
teaching experience, and semester hours in education 
The number of significant correlations was approximately 
that expected by chance. When these presage measures 
were related to the product measures of classroom 
mean residual true gain, the MMPI produced more 
significant relations with product measures than the 
three criteria commonly used for evaluating teachers-- 
years of experience, amount of preparation, and scores 
on the NTE. 

Fielstra (1963) discovered that measures which 
best discrimated the excellent student teachers from the 


poor (using a composite rating scale on teacher 
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15 
performance) were, adaptability to a variety of teaching 
Situations, skill in planning, success in carrying out 
plans, resourcefulness in teaching, and effective teacher- 
pupil relationships. Smalzried and Remmers (1944) 
isolated two factors of teacher effectiveness: empathy, 
which included such traits as a liberal and progressive 
attitude, fairness in grading, attractive personal 
appearance, and a tolerant sympathetic attitude toward 
students, and professional maturity, which included self- 
reliance, effectiveness in presentation of subject matter, 
and confidence. Olander and Klagle (1959) listed emotional 
maturity first among the four best predictive measures of 
success in teaching. 

Lehmann (1961) states that research on instructional 
methods, class size, and use of various media shows no 
distinct advantage for any particular approach in regard to 
learning outcomes. Dressel (1959) lists the following 
factors as being involved in successful teaching: (1) the 
objectives of the course, (2) methods and materials of 
instruction and evaluation, (3) content or subject matter, 
(4) personality and background of the teacher, (5) per- 
sonality and background of the student, (6) physical 
characteristics of the classroom, and (7) educational 
setting and institutional characteristics. Since teaching 
results depend upon the proper balancing of these factors, 
individual rather than general solutions must be found. 


Hence the need for developing means to evaluate 
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16 
instructional practices on an individual basis. 

Dubin and Taveggia (1968) found that no particular 
method of college instruction was measurably to be preferred 
over another, when evaluated by student examination 
performances. However, the case for incorporating a 
variety of stimuli in the instructional process is 
research based. The United States Navy audio-visual 
studies (1967) found that visual displays are twenty-two 
times more powerful than auditory signals in trans- 
mitting impulses to the brain. Evidence indicates that 
disadvantaged students learn best by a multitude of 
sensory experiences. 

One answer to Taveggia's conclusion is given by 
McKeachie (1970). He argues that their study deals only 
with the effects of teaching on course examinations-- 
that if we ask whether knowledge is remembered after the 
final examination, whether it can be applied to new 
problems, or whether it is related to attitudes and 
motives, we find that class size and teaching method 
do make a difference. MacMillan (1971) states that 
alternative instructional approaches have different 
consequences in student persistence, in attitude, and 
retention of learning after the final examination. 

Medley and Mitzel (1962) conducted research to 
find out what patterns of classroom behavior were 
characteristic of those graduates of a teacher education 


program who were effective teachers. Their conclusion 





ot 





sebesed Lsubivibni nse nov ssotsssileuanaaaaae 


tstunidzeg on tsiit bavot (86°L) sippaveT bas nidv@ 4G) je 
be119Ie1q od ot yideiweson esw noktoutyent sgetto 20, beddemt 





noOitsninexs Inobuie yd betsvleve cefw ,seddons: eve © 


6 pnitsreaqroon! 403 9s262 sft \tevewOH +. esdSnemo tag 


¥ \ 
ai esesvotq Ienotiouiseni add ni ilumise 3 seksev 


istieiv-oibits vvsu soectste b3tint sit _. beasd do1sses1 
owis-+-yonews sis aysiqetb Isueiv dang bro 2 (TROL) eslberta 
etsit oi aishipie yrotthus msi lutiewoq sion zomit 
tedit estaotbai gonobiva .nisid sft .o7 soatsane phiszim 
20 shytistiom = yd teed nissl asnsbida Dogeahenhenaes 
s aenrnstisqxs \ieamea 

yd mevip ef molauy.Ionop 2's tppeveT ot-tswens sO 
yino efseb viute wzioett: secs BONDI - SH, .(OTEL) oi fossnom 
--anOltenbmss6:iseauron no poirpsed to atostis ait ihe 
wid 429335 bevodmertiso: ci ophe lyons tortor Mas sw 2£ serts 
wen ot béilaqs sd aso -si +93 ortw Oi tenimexe teat? 
bas ashbusisis, ot betsfo1 ai df ae +0 , 8 gdoxtg 


boristam poisinnsy bos osie aesto ded? ae ow esvitom — 


Jit eetgce (48 OL) ne £LEMOSM. .spne1sI3ib 6 sien Ob 


tnerstiib ever esiinsozqys Sean sap acadts ie cancel 
ons eau mb mopeustenata ute cit 


i . We Pee ae 


aio: (504) or 


> - 4 ; ™ 
Wek Sri? Nias. Cad 









2 


Wi 
was (1962: 320): 

- + « that some behavior patterns ehiecrie in 
securing high ratings from supervisors, high pupil- 
teacher rapport, and a wholesome classroom atmosphere 
have been identified, but that no progress has yet 
been made in finding behaviors effective in 
Serious pupl sy growth. 

Fattu (1963) and Ornstein (1970) review more 
recent research up to 1970. Ornstein discusses the 
categories of teacher behavior research as follows: 
organizing by model systems, by instructional process, 
and by teacher behavior characteristics. He concludes 
that most critics seem to agree that the lack of agree- 
ment in which behaviors constitute good teaching, plus 
the multiplicity of behaviors, has confused the findings. 
Fattu (1963) points out the problems of using student 
behavior as a criterion: (1) achievement is difficult 
to measure reliably and comprehensively, and (2) it can 
seldom be stated with certainly that the change can be 
attributed to a particular teacher or to a specified 
aspect of his behavior. 

Morsh and Wilder (1954) concluded that evidence 
of student change appears to be the most direct and 
reliable criterion but the problem of relating specific 
teacher influences, be they behavior or traits, to student 
achievement is largely unresolved. Ryans (1960) and 
Byrne (1965) agree. According to Mueller (1971), most 
researchers feel that student achievement is, on the whole, 


the most reliable measure available at present. 


In summarizing presage-process research, Flanders 
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18 
(1969) laments the continuing difficulty of relating 
teacher traits to performance variables. Extensive 
research has been undertaken in an effort to equate 
teacher qualities and characteristics with teacher 
effectiveness. These studies have attempted to relate 
effectiveness with (1) intelligence, (2) experience, 
(3) knowledge of subject matter, (4) socio-economic 
Stabussac( Sof cultural) background, and “o)sother aspects 
such as attitude, aptitude, job interest, voice, 
discipline, and cooperation. Phillips (1968) observes 
that although all of these factors may be important in 
the teaching-learning process, research has failed to 
show a Significant correlation between these qualities 
and characteristics, and teacher competence and effective- 
ness. 

Broudy (1969) suggests an alternative to the 
so-far unproductive effort to determine what constitutes 
good teaching: didactic teaching can be defined but what 
he terms "encounter teaching," that which leads to 


Eritical creative learning cannot. Mueller (1971: 231) 


Students of the evaluation process approach 
consensus in the belief that a universal definition 
of good teaching pertinent to all situations and to 
every teacher is unrealistic. Therefore it follows 
that developing the perfect instrument with which to 
evaluate is impossible. Student and teacher behaviors 
and characteristics and the demands of the specific 
teaching situation introduce innumerable variables. 
Logic, then, suggests that teachers be evaluated on 
the basis of student progress toward strictly limited, 
defined objectives. Yet this solution may be 
Simplistic. 
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19 
She offers a possible solution to the problem (1971: 232): 


Since a universally valid instrument to measure 
teaching competence is not available .. . an alter- 
native could be the local development of a useful 
instrument. Bradley (1967) and Kinney describe 
steps in the process that allow enough flexibility 
for adaptation to local goals and philosophy. .. . 
Development of reliable instruments valid for 
specific local situations should open the way for 
coordination of efforts, finding grounds of 
commonality in teaching behaviors to be evaluated. 

Among others, the California Teachers Association 
(1964) and Woodruff and Taylor (1968) have defined 
areas of teaching competency and behaviors that 
provide common criteria for evaluating teaching. 
And instruments designed to meet local needs are in 
existence, e.g., those developed by the Hartford 
Public Schools and the University of Hawaii and 
California Schools. These are important steps on 
the way to determination of what good teaching is, 
if we remember always that no teacher is uniformly 
effective for all classroom situations, learning 
outcomes, and student characteristics. 


METHODS OF EVALUATING INSTRUCTORS 


Introduction 

Many authors offer classifications of evaluation 
based on the purpose for which it is used but evaluation 
in general may be classified as formal and informal. 
The latter is highly subjective. It may include classroom 
Observation, verbal feedback from the students, colleagues, 
and administrators, personal interaction with the 
evaluatee, and value judgements of the evaluatee's 
general competencies. Formal evaluation is based upon 
predetermined policies and involves written evaluations 
which may or may not be valid, depending upon the 
instruments used and the evaluator, but in every case, 


the information is used as a basis for legitimate 
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20 
decision making. The line between informal and formal 
evaluation is not distinct; nor are there research 
findings to assess and/or substantiate the degree of 
influence which informal evaluation may have upon the 
formal. 

There are three common methods of evaluating 
instructors in community colleges: student evaluation, 
instructor self-evaluation, and team evaluation involving 
the instructor, administrator(s), and/or colleagues 
(peers). In Boyer's opinion, (1970) the third method, 
basing evaluation on student attainment of learning 
objectives is most directly related to the purpose of 
evaluation which is to improve instruction. A fourth 
method is a negative one. That is, the policy of the 
institution may simply be that for each instructor, a 
written evaluation must be submitted annually. The 
assumption is made that the instructor is competent 
unless specific complaints are made by students, staff 


members, or administrators. 


Student Evaluation 





Student evaluation is receiving increased 
attention despite the fact that instructors sometimes 
deny the reliability and value of student ratings. 
Bannister (1961) claims that student evaluations, when 
carefully and properly handled, provide the best 
criterion of quality of instruction. Lehmann (1961) 


notes that a commonly voiced faculty concern is that 
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Zh 
student ratings may be influenced by such traits as 
appearance, the severity of grading, the grade received, 
or the amount of homework assigned. Research conducted 
by Clark and Keller (1954) and Rayder (1968) demonstrates 
that student ratings of instructors are not substantially 
related to the student's sex, grade point average, or 
grade(s) previously received from the instructor being 
rated. Rayder (1968) states that students, unlike 
administrators or even teaching colleagues, have the 
OEPORLUNILEy SEG VaewsENneainstruesor in-hiseday-{to-day 
teaching activities and therefore should not be ignored 
as evaluators. 

Most of the self-studies in selected colleges 
and universities (Ladd, 1970) called for the use of 
student appraisals of individual teaching performance. 
The Swarthmore study also asked for evaluation by 
graduates and by outside examiners. However, only New 
Hampshire and Duke specifically called for the use of 
these in tenure and promotion decisions. In most cases, 
they suggest that appraisals go to the individual 
instructor, who, if he wishes, may pass them on to his 
academic superior. Neagley (1970) also advocates student 
evaluation since it can be revealing and at the same time 
stimulate instructors to improve their programs. 
Phillips (1968) claims that instructors are missing a 
valuable opportunity to gain significant insights into 


the effectiveness of their work. According to Phillips 
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(1968: 22): 

The concepts that the purposes of American 
education are to help meet the needs of each 
individual and to help him to develop to his 
maximum potential are widely held. If these 
principles of learning and purposes of education 
are accepted, then it is logical to assume that one 
of the most valid sources of data in evaluating the 
teaching-learning situation and determining teacher 
effectiveness can be gained from the students. 

This concept involves the assumption that unless 

the student perceives teaching as effective teaching, 
it is not effective regardless of the standards or 
Criteria which are met. 

The most common method employed in student 
ratings is the opinionnaire. Most require the student 
Simply to rate his instructor on various attributes 
relevant to teaching ability; several, however, include 
open-ended questions or invite suggestions and comments. 
Whitlock (1966) criticizes rating scales which only 
measure the response of the rater to the set of his 
observations which provided the stimuli for such a 
response. Based on previous research at the University 
of Tennessee, he and others devised a rating instrument 
using “performance specimens" collected from the students 
themselves. They found that the scores had high 
reliability, were less subject to bias, were highly 
relevant, and produced good spread among ratings. 

The possible value of student evaluations is 
demonstrated in a study conducted at St. Johns River 
College (Overturf, 1966). A comparison of scores achieved 


by the full-time faculty on student rating scales over 


two years yielded the following results: (1) Of the 
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full-time instructors ‘rated the first year, 14 did not 
return in the fall. Ten of these were in the oe half 
of the rating. thus reducing the spread of returning 
faculty by nearly one-third. (2) Fifteen instructors 
Wwhoeracea in the Lower half did return; all but one of 
these instructors improved on the next rating. It was 
further reported that faculty members who made significant 
improvement had taken the students' ratings seriously, 
particularly their written comments. 

If student evaluation is used, a number of 
questions remain concerning the best time to administer 
the instruments, who should conduct the procedure, and 
how much value to attach to the results. There is no 
agreement upon the best time. Those who would administer 
student ratings before a course is completed cite the 
immediate feedback as a source of improvement from which 
the same students could benefit. Those who favor 
administering the questionnaires after course completion 
contend “that“it “vs “only with a certain tamountvof per= 
spective that a student can render a reliable evaluation. 
There is general agreement that the best person to 
administer the ratings is the instructor himself. The 
use made of the results in decision making is still a 


controversial issue. 


Self-Evaluation 
Instructor self-evaluation through student 


achievement and feedback is not uncommon or new. What 
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has changed is the increased use of rating scales and 
audio-tapes or audio-visual tapes of classroom operation 
in an attempt to achieve more objective self-appraisal. 
Anderson (1964) lists the advantages of using tapes as 
follows: 

(1) Evidencing interest in the teaching process 
itself by the administration. 

(2) Indicating confidence by the administration 
in the faculty's ability to evaluate themselves as 
professionals and make self-indicated improvement. 

(3) Giving the faculty a workable and frequently 
interesting method whereby they may improve themselves. 

(4) Preservation of anonymity of faculty, thus 
forestalling feelings of "big brother" watching. 

(5) ‘stablishing essentially a self-operating 
and perpetuating system not calling for a great amount 
of time. 

(6) Placing of the dean in the position of being 
Called in for aid by a motivated faculty member, rather 
than being looked upon as an instructor with unwanted 
advice. 

(7) Providing specific and concrete examples of 
problems which can be referred to on replay without 
having to rely on notes or faulty memory. 

According to Simpson (1966), self-evaluation can 
help the teacher define his role as well as help combat 


teacher dropouts. The former is particularly important for 
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as Boy (1963) concluded, unless teachers become involved 
in defining and redefining their role, there is a strong 
possibility that the small percentage of time currently 
available for teaching will be even more greatly 
daimunieheditas. ime tpasses. 9 Simpson’( 1966001 )' states: 
Teacher self-evaluation is almost unanimously 

recommended by teacher organizations and 

professional experts on teacher improvement. 

Regardless of the extent of disagreement on other 

characteristics of good teachers there is almost 

universal consensus that self-improvement based on 

self-evaluation is both desirable and crucial. 
Team Evaluation 

Team evaluation is the most time consuming but 

it can also be the most profitable in terms of improving 
the instructional process. Here the emphasis is on 
evaluation by objectives where the instructor is observed 
as one force in the learning environment. One technique 
for evaluating instructors by student attainment is 
proposed by Israel (1969). It is based on the premise 
that the fendScoPyinstruction must be “agreed "on before 
evaluation procedures can be established and teacher 
effectiveness assessed. The essence of this technique is 
he “development of a carefully selected set of objectives 
for the student to accomplish and an assessment of the 
skills, attitudes, and uses of knowledge exhibited by the 
instructor. The objectives are developed cooperatively 


by the instructor and the administrator. Israel (1969) 


provides three alternative methods for implementing this 
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26 
technique. One distinct advantage of this technique is 
that, in addition to providing a framework for evaluating 
instruction, tu-facihitates instruction. 

Larl[6b, twhemeCalifornia's )“instant «tenure? 
ruling went into effect, Golden West College "seized the 
opportunity to abandon the archaic practice of classroom 
Wisitatiom and ye ureplacetitiwith genuine imstructibonal 
eeordanation »«(Cohen, =1970).". They introduced a new type 
of supervisory scheme. The scheme involves a dean of 
instruction, the division chairman, and the instructor, 
where the “focal point is the learner... Of,;prime-importance 
ignehepiace that badminbstrators sand jiristruchi onal tstait 
are meeting on an issue that enhances the basic purpose 
of the institution--that of predicting, assessing, and 


Causing student learning. 


Recent Developments 

Faculty evaluation and termination procedures 
were developed by a special commission of the National 
Faculty Agsociation of Community and Junior Colleges in the 
United States. They were approved by their board of 
directors and adopted by the NFA delegate assembly (1970). 
These procedures describe the frequency, nature, process, 
and scope of such actions. The criteria and methods of 
evaluation are set at an initial conference between the 
evaluation team and the faculty member, and the college is 
obligated to make a genuine effort to assist each member 


in the improvement of his instruction. Fundamental to the 
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establishment of these procedures are the following 
concepts: 

(1) Such procedures should apply to all faculty-- 
probationary or tenured--from initial date of employment. 

(2) Evaluation and the possibility of dismissal 
are inseparable. 

(3) Evaluation should be made by colleagues 
in the same area of specialization. 

(4) Evaluation should be based on the particular 
instructor's objectives and instructional environment. 

(5) Only those procedures that are conducive to 
improvement and that cannot be applied in an arbitrary 
and threatening way should be used. 

Of the fifteen essential research projects listed 
by Cohen and Quimby (1970), one is that of assessing 
teaching effectiveness. They suggest that a holistic 
model should be developed for decision-oriented assessment 
of teaching effectiveness and that it be developed on the 
following assumptions: (1) That teachers are accountable 
to their students for intended or planned as well as for 
unintended: or unplanned effects of instruction. (2) That 
evaluation of teacher effectiveness is concerned with 
measuring the efficacy ae ee and affective trans- 
actions between teachers and students. 

Sawin (1969) states that sometimes the unplanned 
Or side effects of an educational program may be as 


important educationally as anything else that is happening 
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in the school. There are differing points of view on 
what should be done about unplanned learning once it has 
been discovered, but he is of the opinion that teachers 
need to know what the unplanned effects are and assess 
them on a continuing basis. 

Cohen and Brawer (1969) contend that, although 
evaluation is often stated to be for the purpose of 
improving instruction, the methods seldom relate to 
instructional practices and even less to the results of 
instruction. They propose that evaluation would be more 
meaningful if it were related to instruction as a discipline 
rather than to the person of the instructor. They suggest 
that student achievement of learning objectives as a 
measure of teacher effectiveness is generally acknowledged 
as being more valid than the use of such @riteinkatas,, @aOr 
example, the teacher's effort expended or the various 
perceptions of observers. They aleo note.that faculty 
evaluation may eventually prove effective in promoting 
the development of instructional specialists. Currently, 
a college instructor must be competent in all aspects 
of the instructional process; through instructor 
specialization, an institution may be staffed by a core 
of people who collectively, but not necessarily indi- 
vidually, display excellence in all matters Eohacene tO 


teaching. 


Implications 


The use of student evaluation of the instructional 
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29 
process and of the instructor in the community college, 
recognizes the student as a client who can make judge- 
ments commensurate with his degree of maturity, as a 
person who has the right to influence the instructional 
process to which he is exposed, and as a valuable source 
of information which can facilitate instructional 
improvement and/or decision making. Mayhew (1967) states 
that the college must test its performance through the 
reactions of those who receive its service, just as any 
other profession must ultimately test its performance 
by what happens to its clients. 

Trimble (1968) states that student ratings have 
their dangers. If they are administered by adminis- 
trators they become a form of spying. If the results 
are published’ by students they can inflict, injustice on 
some instructors and make others too concerned about 
popularity. He believes that they do serve a purpose 
when they are administered by an instructor with his 
own students. 

Prerequisite to instructional improvement is the 
desire to improve and the starting point is a self- 
assessment. of present effectiveness. According to 
Lehmann (1961: 358): 

. The prime characteristic of the good teacher 
is that he continually modifies his teaching or 
response to his finds. Thus he engages in 


evaluation and, in evaluating the learning of his 
students, he finds an evaluation of his teaching. 
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Trimble (1968) expresses mixed feelings about 
the results of video-tapes for self-analysis. He says 
that on television, we have come to expect a degree 
of slickness that is quite inappropriate in the class- 
room. In his words 

_ When a teacher sees himself on the tube, 
his little mannerisms and eccentricities shout 
at him and he may try to get rid of them. These 
very mannerisms may be what give color and 
uniqueness to his teaching. 
The chief advantage of self-evaluation is that the 
instructor has the opportunity for self-improvement 
without external threat. 

The effectiveness of team evaluation is dependent 
upon mutual trust and respect, a strong commitment to 
the institutional goals, a recognition of mutual 
dependencies, and a continuous effort to improve the 
instructional process. It is essentially the same 
process as "Clinical supervision" as it is defined by 
MacKay (1971) and Goldhammer (1969). The improvement 
of teaching competence is given higher priority than 
either that of protecting education from incompetence 
or identifying suitable candidates for positions other 
than classroom teaching. In MacKay's opinion (1971), 
team evaluation, involving colleagues and/or adminis- 
trators is a closer approximation to professionalism 
than some of the more usual interpretations of the 
term. 


Goldhammer's (1969) approach to team evaluation 
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31 
is a blend of traditional administrative skills in human 
relations, organization, and interpersonal communication, 
and the skills of the psychological counsellor who works 
in the clinical setting in a counsellor-client relation- 
Ship-evls-lis- approach. is -thelideal, athen jsome,efforRt must 
be made to reach it. Even the best procedures are doomed 
to failure unless those involved in implementing them 
possess the necessary skills. 

In setting specific objectives of instruction, 
there is a possibility of neglecting unspecified learning 
outcomes. When pre and post-tests become ends in them- 
selves, they often pre-determine learning experiences. 
Sergiovanni (1971) suggests the use of additional 
evaluative tools. He emphasizes the need to evaluate 
antecedent, transactional, and outcome variables--in 
other words, the entire process. 

Phe pleqqettwmodel, Gor sivictruck one Gbargedlecture, 
small discussion groups, and independent study), where 
fifty per cent of the scheduled course time is devoted 
to independent study, will require new criteria for the 
evaluation of instruction. The simplest approach would 
be to use student achievement as a basis for evaluation; 
but puniess the program altseliwis,evaluated , the measure 
of student achievement might be misleading. Implementing 
many new programs where the use of "instructional 
packages," library and A-V resources, programmed modules, 


andwtheslike,ane, the; basis cor whale the learning process, 
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32 
means that the success of the program is highly dependent 
upon the quality of content and accessibility of resources. 
How can you evaluate an instructor who for circumstantial 
reasons may be forced to rely upon inferior software? 

The inexperienced instructor will be at a disadvantage 
unless provision is made for assistance from senior 
instructors and various consultant personnel. 

In all three methods of evaluating instruction, 
the use of valid and reliable instruments is essential. 
Rosenshine (1970) divides all types of instruments into 
two Kinds: “category and “rating. fhe ‘former are ‘more 
objective because of limited reliance upon inference. 

Both types have unique advantages and when used together 
provide an optimum measure of teaching effectiveness. 

Self-evaluation and team evaluation are congruent 
with McGregor's Theory Y concerning the nature of man. 

The administrative climate is primarily determined by 

the prevailing assumptions about the nature of man 

(Schein, 1965), and the evaluation procedures employed 
Wl -rerlece this climate. “In Westérn-Canada, the 
instructional staff of community colleges exhibit a 

widely divergent range of qualifications, experience, 

and educational expertise. Obviously the level of 

needs will vary accordingly. It is possible that different 
evaluative techniques might be required for different 

staff members. Those involved in the evaluation process 


should be flexible and prepared to accept a variety of 
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interpersonal relationships, patterns of authority, and 
psychological contracts. 

Working in evaluation groups may not be an 
effective procedure if the members are unskilled in 
interpersonal relationships and group dynamics; Schein 
(1965) suggests training through laboratory methods as 
one way to become more effective. Since sensitivity to 
community needs is basic to the philosophy of community 
colleges, adaptability of the organization is of prime 
importance. Part of this process involves the addition 
or change of programs and/or program content which, as 
a part of the instructional process must be continually 
evaluated. Schein (1965) states that the more the sub- 
system (evaluative groups), which must change, participates 
in decisions about how to manage the change, the less 
likely it is to resist change and the more stable the 
Change is likely to be. 

Self-evaluation as a vehicle for self actualization 
is not likely to become commonplace in educational 
St peut onsicwherd 1 jos Isécubity sis aminimal proroup Genflict 
is prevalent, and employment opportunities are limited. 
Hence the need for increased communication and conditions 
which stimulate collaboration and effect security. 

The negative approach to evaluation has ambivalent 
implications. On the one hand, it implies a professional 
commitment on the part of instructors to their students 


and the college, which negates the need for evaltarwon. On 
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the other hand, it implies that the college is unconcerned 
with teacher competencies and hence the services rendered 
to the students. Neither does it provide for recognition 
of skilled instructors nor interest in and stimulation of 
instructional improvement. It might be argued that 
professional growth is the responsibility of the instruc- 
tors themselves but this is not consistent with organ- 
izational effectiveness (Schein, 1965). Schein emphasizes 
internal integration of individual needs and organizational 
goals as the underlying criterion of organizational 
effectiveness. He suggests that organizations must 
develop training and management development programs 
which stimulate genuine psychological growth, develop 
assumptions about people which fit reality, and train 
its personnel for effective group membership and 
leadership. 

Boyer (1970) states that regardless of who 
designs the evaluation procedures and regardless of the 
techniques employed, certain principles should he 
followed. Morin (1968) lists six guiding principles. 
Egnatoff (1971) lists thirteen principles and conclusions 
based on research. Lehmann (1961) concludes that 
because of the elusive nature of the teaching-learning 
process, no completely adequate mode of evaluation exists, 
but there is evidence that properly constructed rating 
scales are valuable aids in evaluating instructional 


methods and instructors, especially when the emphasis 
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55 
is placed on improvement of the quality of instruction. 
In Rowland's words (1970: 157): 


Each approach to evaluation of college teaching 
has its place as well as its limitations and short- 
comings. None will work effectively unless they 
function in a friendly atmosphere. That atmosphere 
will prevail only when assessment of instruction is 
regarded throughout the academic community as a means 
of accomplishing over-all improvement rather than as 


a threat to specific individuals. .. . Because of 
the very nature of college teaching, its measurement 
Can never be entirely accurate and objective. But 


with effort and cooperation from all involved, it 
certainly can be made less haphazard and subjective 
then i sswnows 


SUMMARY 


Purposes of evaluating instructors include the 
following: (1) improvement of instruction, (2) to 
assist instructors, (3) facilitate administrative 
decisions, (4) reward excellence in teaching, (5) account- 
ability to the public, and (6) students benefit from 
evaluating instruction. 

Above all, criteria upon which evaluation is 
based must be relevant. Criteria may be classified as 
presage (concerned with teacher characteristics), process 
(concerned with the teaching process), or product 
(concerned with observed changes in students). There is 
no consensus of opinion on what weight to attach to each 
category, but product criteria are gaining increased 
recognition. 

Research studies have supported the existence of 


relationships between process and product criteria, and 
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between presage and product criteria. These studies 
represent a minority of the research attempts to link 

the categories. More recent studies have Supported the 
use of audio-visual media and the direct relationships 
between instructional approaches and student attitude, 
persistence, and retention of learning. Because of the 
multiplicity of variables involved in the learning 

process and the confusion resulting from research findings, 
emphasis is now being placed on the following: 

1. Developing means to evaluate instructional 
practice on an individual basis 

2. Concern with "encounter teaching" and student 
change in the affective and cognitive domains of learning 

3. Evaluation based on student progress toward 
limited, defined objectives 

4. Local development of useful evaluation 
instruments. 

There is increasing evidence of the reliability 
of student evaluation of instructors and programs. There 
are many benefits to be derived by both instructors and 
Students when open-ended questions or "performance 
Specimens" constitute a part or all of the rating 
instrument and when the instruments are properly 
administered and interpreted. 

Instructor self-evaluation has great potential, 
particularly with the increasing number of technological 


devices available as assists. It offers many advantages 
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to both administrators and instructors. 


Team evaluation may involve administrators, 


colleagues, and/or students. It can be as time consuming 
as the team®prefers. It may involve one or more of the 
following: joint setting of objectives, classroom 


observations, evaluation of tests and examinations, 
modification of program content, teaching methods, or 
physical factors, subjective assessments, student 
assessments, student achievement, and so on. 

The National Faculty Association of Community 
and Junior Colleges in the United States has developed 
and adopted a set of faculty evaluation and termination 
procedures. 

Tt has been suggested that a holistic model for 
decision-oriented assessment of teaching effectiveness 
be developed on the following assumptions: (1) that 
teachers are accountable to their students for unplanned 
effects of instruction, and (2) that evaluation of teaching 
effectiveness is concerned with measuring the efficacy 
of affective as well as cognitive transactions between 
teachers and students. 

Emphasis is being placed on achievement of learning 
objectives as a measure of teacher effectiveness. One 
potential factor of faculty evaluation is that it may 
promote the development of instructional specialists. 

Student evaluation of the instructional process 


and the instructor constitutes a valuable source of 
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information. 

Self-evaluation of teaching effectiveness is a 
prerequisite to the improvement of teaching performance. 

Team evaluation requires many skills; without 
these skills, the evaluation procedures have little 
chance for success. 

Not all objectives of instruction can be 
specifically stated, much less measured. Many experts 
Caution against extremely rigid means of evaluating the 
teaching-learning process. 

The changing modes of instruction as well as the 
variety of programs offered in community colleges 
necessitate the development of varied criteria and 
instruments for instructor evaluation. Category and 
rating instruments, when used together, yield an optimum 
measure of teacher effectiveness. 

There are principles and conclusions based on 
research which should serve as guidelines in the develop- 
ment and improvement of evaluation procedures. But no 
approach to the evaluation of college teaching will work 
effectively unless evaluation is regarded basically as 
a means to improving instruction. 

All three methods of evaluation (student, self, 
and team), depend upon the existence of maximum 
communication and conditions which stimulate collaboration 
and effect security. Commitment to the philosophy of 


the community college is essential. 
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Total accuracy and objectivity in the measurement 
of college teaching is not possible and perhaps not 
even desirable. Yet the community college may, with 
its emphasis on good teaching and through its efforts 
to evaluate instruction, make a major contribution to 


the theory of instruction. 
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Chapter 3 
fies DESIGN? Oba Tree STUDY 
SYNOPSIS OF THE PROBLEMS 


The emphasis placed On specific purposes of 
evaluating instructors has an effect on the receptivity 
of an instructor to classroom observation sg eta as on 
his communication with administrators and other staff 
members. The methods used evoke his confidence or lack 
of confidence in the resulting evaluation. This study has 
attempted to determine the purpose most emphasized and 
the methods most commonly used in evaluating instructors 
in community colleges in Western Canada. 

An instructor who seeks an administrative 
position or an improved position as an instructor, with 
the accompanying rewards, is better able to direct his 
efforts toward his particular goal if he is aware of the 
criteria upon which his evaluators base their judgments 
and recommendations. This study has attempted to 
determine whether or not evaluators in community colleges 
in Western Canada apply a common body of criteria when 
evaluating instructors regarding (a) their competence as 
teachers, and (b) their suitability to an administrative 


position. By applying identical criteria to both 
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Al 
evaluative situations, one could determine whether there 
was a change in emphasis from one evaluative situation 
to another. 

The emphasis placed upon each of Mitzel's three 
categories of process, product, and presage criteria 
could also be established. This study also attempted to 
identify any relationships which existed between the 
evaluative criteria used by evaluators and variables 
such as the age of the evaluator, his administrative 
position, length of experience in this position, the 
amount of time he is engaged in classroom teaching, his 
teaching experience, and academic qualifications. Finally, 
this study sought to determine whether evaluators used 
criteria in addition to those listed in the instrument 


and to analyze the nature of these additional criteria. 
THE INSTRUMENT 


Two instruments were used. The first, which is 
included in Appendix A, page 148, is a questionnaire 
which requested the following information from each of 
thirty community colleges in Western Canada: . 

tv. Therrname of athe ncolblege 

2. The number of people involved in evaluating 
unstructorsdin the college . 
3. The name of a staff member who would accept 


the responsibility for distributing the second instrument 


to and collecting the completed second instrument from 
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the evaluators in the college. 

4. The primary reaeones in order of importance, 
for evaluating instructors in the college 

5. The methods used in evaluating instructors 
in the college. 

The second instrument, which is included in 
Appendix A, page 151, consists: . of two sections: a 
Personal and Professional Data Questionnaire and an 
Instructor Evaluation Questionnaire. The former 
included nine variables: 

1. Number of instructors whom the evaluator is 
responsible for evaluating 

2. The evaluator's administrative position in 
the college 

3. Length of experience in this administrative 
position or a comparable one 

4. Age of the evaluator 

5. Amount of time the evaluator is engaged in 
Classroom teaching 

6. If not teaching, the year during which the 
evaluator last did any classroom teaching 

7. Years of teaching experience 

8. Degrees and diplomas held and the year each 
was obtained 

9.° Date of the most recent course taken, name 
of the course, and institution where taken 


The second section consisted of two parts: 
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1. A questionnaire for the evaluation of 
instructor competence 

2. A questionnaire for evaluating for promotion 
to an administrative position. 

Both of these questionnaires included the same bierey, 
evaluative criteria, although the criteria were ordered 
differently. The criteria were identified as being ten 
each of Mitzel's three criteria of process, product, and 
presage. Space was provided for free comments and the 
listing of criteria used by evaluators but not included 
in the list of antes criteria. 

Response categories for the evaliiative Criteria 
sections were scored according to a scale which indicated 
whether evaluators used each criterion always (A), 
frequently (F), seldom (S), or never (N) when considering 
whether teachers were competent classroom teachers or 
were worthy of promotion to an administrative position. 
The criteria of evaluation used in the Instructor 
Evaluation Questionnaire are a modification of the 
criteria prepared by Moore (1966) and selected for 
inclusion nue instrument he used in his study, after 
a pilot study had been carried out to isolate ten in each 
of the categories suggested by Mitzel: that LeLverpauct, 
Process, and Presage. see Appendix B for Moore's 


grouping of criteria according to Mitzel's categories. 
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COLLECTION OF DATA 


The first instrument was sent to the chief 
executive officer in each of thirty community colleges 
in Western Canada. The names and addresses of these 
colleges were extracted from the publication College 
Canada, October, 1970. Twenty-nine colleges responded; 
twenty-six colleges completed the questionnaire and two 
of the remaining four sent printed information regarding 
their evaluation procedures and criteria used in 
evaluating instructors. Twenty out of twenty-six 
colleges specified the exact number of staff members 
involved in evaluating instructors. The return on the 
second instrument was almost eighty-one per cent 
(calculated for the above twenty colleges). This 
represented 182 returns, while the total number of 
returns was 250. Four of these were not useable, 


leaving 246 returns to be analyzed. 


Personal and Professional Data 





Table 1 presents information concerning the 
respondents. Nearly seventy per cent (68.7%) of the 
evaluators held positions as department heads or program 
heads (category 2), or divisions directors or division 
chairmen (category 3). The categories were as follows: 

1.. Coordinator, supervisor, librarian, 
instructor, or chief instructor 


2. Department head or program head 
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3. Division director or division chairman 

4. Assistant dean, associate dean, dean, 
registrar, assistant administrative officer, assistant 
principal, vice-principal, or principal. 
Approximately twenty per cent (20.7%) of the evaluators 
were responsible for evaluating more than twenty-five 
instructors. Nearly ninety per cent (89.5%) of the 
evaluators had been in their present administrative 
positions (or comparable ones) for ten or fewer years. 
Approximately seventy per cent (69.5%) of the evaluators 
were between the ages of thirty and fifty. About 
twenty per cent (19.9%) were not engaged in any class- 
room teaching and of these (49), forty-four (ao) 
had taught within the last five years. Thirteen per 
cent had under five years of teaching experience. 
Approximately thirty per cent (29.3%) of the evaluators 
held one or more degrees in Education. The categories 
were as follows: 

ane be Es 

21 M. Edw Ed.@D., HD. in Edueations: or 
comparable degrees in Education 

3. 3B. Ed. plus another degree(s) not in Education 

4. One or more degrees but none in Education 

5. Diplomas, certificates, and other comparable 
credentials. 
Nearly two-thirds (65.9%) of the evaluators had taken 


a course(s) in the last five years. 
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Statistical Procedure 

Purposes of evaluating instructors were 
categorized as follows: 

1. Primarily for the improvement of instruction 

2. As a basis for administrative decision 
making 

3. Other purposes 
The maximum number of reasons given by a single college 
for evaluating instructors was five. A frequency count, 
based on the three categories, was made and a weight of 
5, 4, 3,Ween0rnd esstgqnedrtoseach, ethe weight corres- 
ponding conversely to the order of importance in which 
it was listed. A total weight was calculated for each 
category, enabling the determination of the emphasis 
placed on each category. A frequency count was made 
of the methods and techniques used in evaluating 
instructors. 

Data analysis on the second instrument was 
performed using the IBM 360/67 computer and programs 
documented by the Division of Educational Research at 
The University of Alberta. 

A frequency count was used to place criteria 
in rank order for both evaluative situations according 
to the percentage of respondents scoring A ("Always") 
or F ("Frequently"). This enabled the determination 
of whether or not evaluators applied a common body of 


criteria when evaluating instructors for (a) teaching 
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competence, and (b) administrative promotion. 

The rank ordering of criteria used in evaluation 
for the two evaluative situations enabled comparisons to 
be made of the emphasis placed upon individual criteria 
employed in each of the two situations. 

The Spearman rho correlation from ranks was 
Calculated to determine whether Of not any Overall 
difference existed between the two different evaluative 
situations and the ranking of all thirty criteria as 
used in the two evaluative situations. 

When the thirty criteria, ranked according to 
frequency, were classified according to Mitzel's 
categories of process, presage, and product, it was 
possible to compare the emphasis placed upon these 
Categories of’criteria. 

A factor analysis was performed to determine 
whether criteria tended to cluster in Mitzel's cate- 
gories of criteria; an absolute value of .40 was used 
as the lowest level of significance. For this purpose, 
the data were assumed to be interval scaling. 

Chi square tests were used to ascertain whether 
significant differences existed according to Specific 
categories of six personal and professional data 
variables. An alpha level of .05 was used as the 
confidence level to reject the null hypothesis that no 
significant differences existed. 


Additional criteria used by principals were 
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ranked according to frequency of mention. An arbitrary 
weighted score was assigned to each criterion on the 
basis of an allotment of five points for each A ("Always"), 
three points for each F ("Frequently"), and one point 
for each § ("Seldom"). Further categorization was done 
according to a classification scheme devised by Barr 
(1948: 207-211). 

Comments on the study made by respondents were 
Classified under five headings: 

1. General Reaction to the Instrument 

2. Criticism of the Instrument 

3. Methods of Evaluation Used 

Aweecelect1on Of “Administrators 

5. Criteria 


6. General comments 


LIMITATIONS AND DELIMITATIONS OF THE STUDY 


Limitations 

This study was essentially a replication of 
Rogers' study. It was limited to the basic format of 
the instrument used in that study although a number of 
the criteria were modified for purposes of clarification. 
Different personal and professional data variables were 
used in this study but no attempt was made to adapt the 
criteria used in Rogers' study for use in community 
colleges. 


No personal contact was made with the selected 
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colleges. Information regarding evaluation procedures 
was limited to printed material if it was available 


and/or short comments on the questionnaires. 


Delimitations 

The study was delimited to community colleges 
in Western Canada (British Columbia, Alberta, Saskatchewan, 
and Manitoba), and only those listed in College Canada, 


DeTrobern, 29/0. 
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Chapter 4 


PURPOSES OF EVALUATING INSTRUCTORS AND 


METHODS EMPLOYED 
METHODS 


One of the purposes of the study was to 
determine the methods and techniques used in evaluating 
instructors in community colleges. 

Table 2 lists the methods used and the fre- 
quency of use by twenty-eight community colleges in 
Western Canada. The most frequently used method was 
that of student evaluation (16). In nine of the six- 
teen colleges, student evaluation of instructors is 
obtained through the use of questionnaires or opinion- 
naires. Three of the sixteen colleges indicated that 
student: evaluation was verbal and informal. The 
remaining four colleges did not specify the manner in 
which student evaluation of instructors was elicited. 

The second major technique employed was that 
of classroom observation (15). Ten of the fifteen 
colleges specified the use of check lists “Or raring 
forms for evaluating instructor performance in a 
classroom situation. 

The third major method used was team (coop- 
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Table 2 


Methods and Techniques Used in Evaluating 
Instructors in Community Colleges 
N=28 


IS 





— 


Student evaluation 
Classroom observation 
Team evaluation 
Colleagial evaluation 
Governmental rating forms 
Self-evaluation 


Informal evaluation of lesson 
and course material 


General observation 

Personal discussions 
Informal subjective analysis 
Course evaluation 
Success of students 


GOnMceLbutLon to college, 
community and conferences 


Negative evaluation 


Hearings 


Frequency of Use 


16 
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54 
erative) evaluation (14). This would include evaluation 
of an instructor by a committee or evaluation by more 
than one evaluator. Self evaluation was listed by only 
one college; colleagial (peer) evaluation was listed by 
Six cOlleges. Four colleges indicated the use of 
Provincial, aCivileservice, of Public service rating 
forms, although one of these colleges had adapted the 
Government rating rate for its own use. 

One college listed the use of "negative 
evaluation"; that is, no evaluation is made unless a 
specific complaint about an instructor is received 
from students, administrators, or other staff members. 
Five colleges indicated that they were either currently 
reviewing or just developing their evaluation procedures. 

Thirteen colleges returned printed material 
concerning the evaluation of instructors. Three of 
these thirteen included formal written guidelines for 
instructor evaluation in their colleges. All three 
specified that use of evaluation committees with policies 
Closely related to those adopted by the National Faculty 
Association of Community and Junior Colleges in the 
United States (1970). One of the three indicated that 
the criteria used for instructor evaluation had been 
determined by a committee consisting of administrators, 
faculty members, and students. 

From the comments and the information returned 


with responses to the questionnaires, it was evident 
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that a number of colleges had interviews or conferences 
with the instructor after he had been evaluated. 

Several colleges requested the instructor to complete 
part of his own profile form and in one case the lis eruelo a 
was invited to include additional information concerning 
his participation in community activities. The profile 
form 1S filed in an Bae Weta ee office and is 
accessible at all times to the instructor. 

The findings of this study might be compared 
with a similar study carried out in the United States. 
In a. survey of current practices in the evaluation of 
college teaching (Lee, 1967) in the United States, 
classroom teaching was the highest ranked Crier lon um 
all eight types of undergraduate colleges, for promotion, 
salary, or tenure. But in community and junior colleges, 
it was much more heavily weighted than any other factor. 
when the sources of evaluative information were requested, 
it was found that in community and junior colleges, 
Classroom visits ranked third. There are many factors 
precluding the use of classroom Visitseas a GOUrce OF 
information to evaluate instructors but on the basis of 
both studies it might be questioned why more community 
colleges aren't using direct sources of information tO 
evaluate teaching since their integrity as institutions 


of teaching and learning is at stake. 
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PURPOSES OF EVALUATING INSTRUCTORS 


Of the many reasons why instructors are evaluated, 
the emphasis placed on a specific purpose partially 
determines the instructor's attitude toward evaluation. 
The evaluative climate reflects this emphasis and if 
evaluation is viewed by an instructor as a threat to 
his security, little benefit will be derived by either 
the instructor or the college. 

This study attempted to determine the purposes 
of evaluating instructors in community colleges as well 
qemele tenors rs placed Of a speci 1c purpose, The 
purposes were categorized as follows: 

1. -Primarily for the improvement of instruction 

2. As a basis for administrative decision 
making 

3. Other reasons 
In the first category were included items such as 
assistance to instructors, achievement of objectives, 
to increase instructional effectiveness, to share 
innovative ideas, and so on. Such items as salary 
increments, tenure, promotions, and the like were 
included in the second category since they were viewed 
primarily as aids to administrators. 

The first instrument requested that the purposes 
of evaluating instructors be listed in order of 
decreasing importance. Weights were then arbitrarily 


assigned as follows: the first purpose listed--5, the 
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second purpose listed--4, the third--3, the fourth--2 
and thebaisun--=lef TableaSinankssthecthree’ categories 
by total weight. The emphasis placed on improvement 
Of instruction was almost twice.that placed on the 
evaluation of instructors as a basis for administrative 


decision making. 


Table 3 


Emphasis on Purposes of Evaluating 
Instructors by Category 
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Category | - Total Weight Rank 
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Primarily for improving 
inistrucri On Tatehs: 1 


As a basis for administrative 
decision making 94 2 


Other purposes 24 3 
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Table 4 lists all the purposes of evaluating 
instructors and their respective weights. They have 
been reproduced as originally written and in the same 
order as they appeared on the returned questionnaires. 
The purposes’ aré listed by college to enable a comparison 
of differences in emphasis. While the overall emphasis 
of the twenty-six colleges is on improvement of 
instruction, the emphasis varies from one college to 


another. 
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Table 4 


Purposes of Evaluating Instructors in Each 
College by Category and Weight 
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College Purposes of Evaluating 
Number Instructors in Decreasing Category Weight 
Order of Importance 


a a 





We Qualtey Coneror 2 5 
Salary Adjustment 2 4 
Re To evaluate ability to impart 
knowledge 1 3) 


To-assess -1f “instructors are 

working toward terminal 

behavior i 4 
To assess ability Lo Dleneand 

organize lessons and methods and 

techniques used ih. 3 
To assist Instructors where 

possible in improving their methods 























and techniques of presentation al 2 

To assess whether instructors are 

meeting predetermined objectives a iL 
3. To identify areas of individual 

weakness and strength as a basis 

for counselling and remedial action 1 5 

To mutually arrive at performance 

objectives 1 4 

As a basis for salary increments 2 3 
A To ensure their teaching competence 

is adequate to meet the needs of the 

program 1 5) 


To ensure their technical knowledge 
meets the standard for their trade 
or profession ah A 


a a 








aie To ensure that each instructor be 
given the maximum opportunity and 
assistance to grow (develop) into 
an effective teacher 1 5 


§c 
































. 
Fae 1D, 3 Sad prices 


pose nt ; 
sr ipt oW brs aopatey 


ee ee ns 


——— A Stee 






pittsets Va’ ao; 2 aie 
tipiseW yxopectsD pi ass3oee, nt se exon 
29s J LOgML to EBHO., 








2 , foxtnos y9 shai. af 

pb c sisasent BA CtBERe. he 
iMsqmt oF VILLE d6. aitstrits A) or - 

a f 


SpbotwoHst: 

Sif e1yocouutenl ti aesees-ot > 
fscimist biswes. poiasow: eo 

i DS ot tOfvsead 


bon nisigq oF yorEh ids a29¢e6 oT a 
bis ebortom bis sHoBeer Shee p10 e 
€ f _  - beer ‘acta pircioss a 
srotw e107 sada genk jetees. oT 
eborijom .~Lsas aon OMQME att “sicdteeog vs 
S [ HO.£: BAAS S mia Zo soupiniiosst bois : Pe 
Sis si07otisent yeisenw #29285 oT owe 
f [ °° gavistoetdo bsAre evebesy anijoam ai 
isubivibnak: 20 e6sas {tidnebi oT ok 
: iz f asd B 86 A: Ipispite PAS aperisaw 4: : 
C { nOLtjos fsibenst ors pn kt isertios 3I07 7 
SonsMmiot4sa t6 Sve a Leu tim oF os 


f ' aeyisospdo iu 
E S etnomstont- vwrelee 10% ahebs 5 ak 5% 


a2 a 


Fe 


1 7 : ing 
sonetsumon. piririns ss hanes atonal oT 7 
ait 20 -ebsary srid 9S | oF oF SUE oes Dis Eva 





cu 






SpbSsiwona » ob bia ad ae 
gbsae aa Jel yo? btaba 





< S70 i + 


ate 


59 


Table 4 (continued) 


a a 





College Purposes of Evaluating 
Number Instructors in Decreasing Category Weight 
Order of Importance 








6. Tojhelpuanstructonmpzinpomet 
weaknesses in methods 1 5 
Toghelp dnstructorsaincrease 
effectiveness of total course 1 4 
To get student evaluation of 
course value in a curriculum i Ss 
Tosevaluace IMStructoneror 
promotional purposes 2 2 
Te For pay purposes--increases are 
based on performances Z 5 
For effectiveness of instruction-- 
constructive criticism ah 4 


For efficiency of operation-- 
overtime, the ineffective or 
instructor of limited range of 











talent can be eliminated 2 3 

To bring home the continuing 

concern for performance il Z 
ah Assasteinstructors 1 5 

Permanent appointment and 

increments 2 4 
Sh To improve the teaching function 

OfnthescolLlege al. 5 

Basis for permanent status 2 4 

LOG For renewing annual appointments 

during probationary period 2 5 

For confirming tenure of staff 2 4 

In assessing promotional potential 2 3 


—- ee a A 





ike For the improvement of instruction vk 5 
For the evaluation of instructors 
to decide whether they should be 
promoted to a tenure situation, 
whether they should be retained as 
instructors, 6c. 2 4 
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Table a6 (continued ) 


pa a 
eee Se ee 


Purposes of Evaluating 
Instructors in Decreasing Category Weight 
Order of Importance 


a 


Improving and developing 
instructional competence 1 5 
Sharing information--who is 

doing what innovations 1 
As evidence in granting tenure 2 
Protect students from malpractice 2 


Nw Wop 








Improve quality of instruction a 5 
To identify and assist instructors 

who may be experiencing difficulty 
wilthyelassestandrecurriculum i 4 
To provide information for the 

completion of an employee 

performance rating questionnaire 

as required annually by depart- 

mental regulations 2 3 
To provide information for 

recommending to the Department 

of Education that Teaching 

Certificates be granted 2 2 


—— ae 





Tenure Z 5 





To assess the effectiveness of 

the August in-service education 

program for modification where 

necessary 5 5 
To assess the individual 

instructor's ability to guide the 

students’ learning toward the 

instructional objectives i 4 
To offer help and advice to 

instructors on instructional 

design and performance 1 3 
TO assist administration in 

tenure decisions 2 2 
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Table 4 (continued ) 


Oo ———_——EES——— SSS EEE Ee + 


Purposes of Evaluating 
Instructors in Decreasing Category Weight 
Order of Importance 


To ensure proper standards 

Of education are provided 

to enrolled students ai 5 
To assist instructors to meet 

standards required and to aid 

i” amykarisingwdrtfevemlty in 





Classroom instruction i 4 
Improvement of instruction i 5 
Renewal of contracts 2 4 
Salary increments 2 3 
Teaching ability and success 1 5 
Community involvement 8 4 
Research S 3 
Maintenance of high level 

instruction x0 5 
Provide to instructors formal 

Opimron eof thisiaworth 3 4 
Provide college with evidence 

SEP pEOLIclency (Of faculty 2 3 
Excellence of teaching uh 5 
Dedication to their own 

continued academic growth @ 4 


Concern for comprehensiveness 
of the educational offerings 
provided by a regional college 1 3 


Or helo ae 
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a i a i ee 


Purposes of Evaluating 


Instructors in Decreasing Category 


Order of Importance 


Weight 





a er 


To gauge the effectiveness 
of the instructor in the 
Classroom and to attempt 

to measure the quality of 
instruction 

To seek out and recognize 
new and exciting approaches 
to teaching and to pass such 
ideas on to other instructors 
Mo assist) anstructor.to 
recognize any weaknesses in 
his methodology etc. so that 
these may be rectified (by 
himself or with assistance 
from others 

To.assist in determining 
GOntinvatlon OfeInSeEructor: s 
appointment 


Contract renewal 
Complaints 
Promotion transfer appointment 





To improve instruction 
TOmassist Instructor to have 
a rewarding experience 

To establish merit increments 
on Master Teacher designation 
To make decisions regarding 
beotenc On Oc. Scie 





To assess the effectiveness 
of the instruction 

To share new teaching methods 
To assist the anstructor in 
improving his effectiveness 
Tenure 
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Table 4 °Ccontinued) 


Purposes of Evaluating 
Instructors in Decreasing 
Order of Importance 





Attempt to measure the 
Gality Of instruceron 
To identify innovative 
methods 

Toeara =the Instruccorein 
improving instruction 
Administrative decisions 


a a a 


To gauge the effectiveness 
of instruction 

To seek effective instruc- 
tional methods 

Towassist the einstsucr or 
in improving his methods 
Tenure 
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SUMMARY 


A combination of methods and techniques for 
evaluating instructors is used by most community 
colleges in Western Canada. Student evaluation, 
classroom observation, and team evaluation are the 
most frequently used methods. 

One college stated that the choice of methods 
usedSantevaluating! instructorsiis lefteupeto’ each 
department. Another college indicated that faculty 
cooperation and open communication negated formal 
Sevaim@atlOn or Insthuctons byeadministrators, Several 
colleges indicated that they were considering the 
implementation of student evaluation of instructor 
performance and/or courses and programs. Colleagial 
evaluation and self-evaluation were not commonly used 
by the colleges. 

The purpose of evaluating instructors which was 
most emphasized collectively by the colleges was that 
ofsimproving instruction. An analysis’ Of \Table 4 reveals 
that seven of the twenty-six colleges do not consider 
the improvement of instruction as the primary purpose 
of evaluation. Since the purpose most emphasized will 
depend to a large extent on the administrative level 
iivoivedylthe findings couldedister! wiydifferent 


sources of information were used. 
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Chapter 5 


EVALUATIVE CRITERIA 


One of the purposes of the study was to 
determine whether or not evaluators employed a common 
body of criteria, chosen from among the thirty listed 
for scoring, when (a) evaluating instructors' competence 
and when (b) evaluating instructors as being suitable 
for an administrative position. 

EVALUATIVE CRITERIA COMMONLY EMPLOYED BY EVALUATORS 
OF INSTRUCTORS IN COMMUNITY COLLEGES 
IN WESTERN CANADA 
Evaluation of Instructor Competence 

For Instructor Evaluation Questionnaire One, 
evaluators scored thirty criteria which they may or 
may not consider when their purpose was to evaluate 
instructor competence. Each of the thirty criteria 
was sCcOred Om ayfour point scale, @accordingsto the 
respondent's use of it when evaluating: always, 
frequently, seldom,| oF never. 

Table 5 ranks these criteria according to their 
use, “always}; Or “Erequentiy, Sby evaluators. Nineteen 
of the thirty criteria were used "always" or "frequently" 
by a majority of the respondents. Four were "always" or 
"Frequently" employed by more than ninety per cent of 
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69 
the evaluators. The data support the conclusion that 
community college evaluators employed a common body of 
criteria when evaluating instructor competence. Rogers 
(1970) drew the same conclusion in his study but found 
that almost all (28) of the criteria were used "always" 
COM erequent ivi byea Majoriuyeor the principals in 
Alberta secondary schools. 

The criterion of The Enthusiasm Displayed by 
the Instructor in Teaching ranked first; it was used 
"always" or "frequently" by ninety-seven per cent of the 
respondents. Ranking second was the criterion of The 
Dependability of the Instructor (97.1%) and third was 
Instructor-Student Relationships (95.6%). It was 
concluded that evaluators conceived of a competent 
instructor as being one who was dependable, displayed 
enthusiasm in his teaching, and who maintained good 
relationships with his students. The fourth ranked 
criterion was The Instructor's Knowledge of the 
Curriculum (93.4%); the fifth was Qualities of Leader- 
ship Displayed by the Instructor (89.3%); the sixth and 
seventh were respectively Lesson Preparation and 
Planning (89.0%) and The Degree of Cooperation by the 
Instructor with Other StarteMenbers (88.0%). 

Some evaluators stated in their comments that 
they would have preferred to weight the criteria rather 
than indicate usage, as a means of indicating the 


importance of each criterion in assessing instructor 
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70 
competence. Some evaluators also felt that in different 
situations different criteria would be used in differing 
degrees. 

When only the response category of "always used" 
was considered, and then only at the fifty per cent 
level of frequency or greater, it was found that five 
criteria were isolated: 

1. The dependability of the instructor (68.7%) 

2. The enthusiasm displayed by the instructor 
in teaching (67.4%) 

3. Lesson preparation and planning (65.4%) 

A Jet hetrernistructon’ saknowledge:- tof “the 
curriculum (63.9%) 

5. Instructor-student relationships (52.7%) 

It was concluded that there was some consistency 
by respondents concerning common evaluative criteria 
£OLE rating tistrucior competence: 

Bvaluatwon £or Promotion eogan 
Administrative Position 

In Instructor Evaluation Questionnaire Two, 
evaluators scored the same thirty criteria in the same 
way “de ‘thelcriterialin Instructor Evaluation Questionnaire 


One. but the criteria were ordered differently in the 


s 
second questionnaire. In this case, the evaluative 
situation was assessing an instructor's suitability to 


an administrative position. 


As before, the criteria were ranked according to 
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Pie, 
the frequency with which evaluators stated they "always" 
or "frequently" used each particular criterion. The 
results are shown in Table 6. Seven criteria were used 
walways” Or “frequently” by more than ninety per cent 
of community college evaluators. Twenty-three of the 
criteria were used for administrative promotion by the 
majority of the respondents. This suggested that 
evaluators employed a common body of criteria when 
evaluating instructors for administrative promotion. 

The criterion which ranked first was The Degree 
of Cooperation by the Instructor with Other Staff 
Members. The Dependability of the Instructor ranked 
second; more than ninety-one per cent of the respondents 
said they would "always" use this criterion. Ranking 
third was the criterion of Qualities of Leadership 
Displayed by the Instructor (99.0%). 

The Personality Attributes of the Instructor 
ranked fourth (97.0%) and Instructor-Student Relation- 
ships fifth (92.1%). The sixth and seventh were 
respectively The Enthusiasm Displayed by the Instructor 
in Teaching (91.6%) and The Instructor's Knowledge of 
the Gurriculum) (91.2%). 

The five criteria which ranked the highest 
according to their use "always" or "frequently" by 
evaluators were all concerned with the instructor's 
personal qualities which might suit him for a leader- 


ship position, or with human relations skills. 
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CRITERIA USED INFREQUENTLY IN THE 
TWO EVALUATIVE SITUATIONS 
Evaluators commonly did not use certain criteria 
with a high frequency, just as they did employ a common 
bedy of criteria with consistency. This was true for 


both evaluative satuations. 


Evaluation of Instructor Competence 


Table #) presents the sanking Of Criteria which 
were used "seldom" or "never" when evaluators were 
assessing instructor competence. 

The least used criterion was that of The 
Instructor's Standing in the Community. This criterion 
was used "seldom" or "never" by eighty-seven per cent 
of the respondents. The Development in Students of 
a Sense of Community Responsibility ranked second in 
most infrequent use, and The Attitude of Students to 
Authority was the next lowest ranked criterion. The 
fourth lowest ranked criterion was Attitude of Students 
Toward Self-Conduct; the next lowest ranked criterion 
was that of The Students' Clarification and Recog- 
nition of Values, which ranked twenty-sixth out of the 
Lhiirey Chitceria, 

Except for the least used criterion, some of 
the Gvaluatorss felt that the other four criteria were 
more relevant to the elementary and secondary school 
Situation. 


One of the respondents said that he found it 
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17 
Giestcule LO score any of the thirty criteria in the 
"seldom" or "never" categories since they would all be 
considered but weighted differently. Eleven of the 
thirty evaluative criteria were found to be commonly 
used "seldom" or "never" by evaluators when evaluating 
instructor competence. As one respondent commented, it 
is very difficultoto change a student's attitudes once 
he has reached the age required for post secondary 
education. 


Evaluation for Promotion to an 
Administrative Position 


a er rr i 





The ranking of the criteria used least frequently 
by evaluators when assessing an instructor's suitability 
to an administrative position is presented in Table 8. 

In this evaluative situation the least used 
criterion was that of Examination Results; the second 
lowest ranked criterion was The Students Work Well 
without Supervision and the third lowest was Checking of 
Written Work. Attitude of Students toward Self-Conduct 
and the Use of Teaching Aids were also infrequently 
used criteria. Rogers (1970) found both Examination 
Results and The Use of Teaching Aids among the three 
most infrequently used criteria for evaluating teacher 
competence. In view of the emphasis placed on the use 
of audio-visual media for instructing the disadvantaged 
student it may be that the latter criterion warrants 


greater use in the future. 
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In both evaluative situations, the criterion of 
students' examination results occupies a low position in 
the hierarchy of criteria (twentieth for instructor 
competence and thirtieth for administrative promotion). 
This may be indicative of the current de-emphasis on 
marks or it may reflect a lack of concern regarding the 
high drop-out rate in community colleges. 

Evaluators employ a common body of criteria, 
chosen from among the thirty listed for scoring, when 
evaluating instructor competence and when evaluating for 
administrative promotion. However, different criteria 
were differently stressed in the two situations. 

COMPARISONS OF EVALUATORS' EMPHASES PLACED ON 

CRITERIA OF EVALUATION EMPLOYED IN EACH 

EVALUATIVE SITUATION 

If the reward for good teaching is promotion 
to an administrative position, the implication is that 
good teachers make good administrators. There are many 
who would question such a statement. 

One purpose of the study was to determine whether 
evaluators of community college instructors use the same 
Criteria of evaluation when evaluating instructors as to 
(a) their teaching competence and (b) their suitability 
£0 an administrative position. If evaluators think that 
competent instructors can and/or will become competent 
administrators, they will place approximately the same 
emphasis upon (a) individual criteria, and (b) categories 


Of Griterias 
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Emphasis Placed Upon 
individual Criteria 


Table 9 presents the rank order of the evaluative 
criteria employed in each of the two evaluative 
Situations and also the degree of difference of stress 
placed on individual criteria. A different emphasis 
was placed upon many criteria as the evaluative Situaclon 
Changed. The highest ranked criterion for instructor 
competence--The Enthusiasm Displayed by the Instructor 
in Teaching--ranked sixth for administrative promotion. 
The Dependability of the Instructor ranked second in 
both evaluative @situations.¥ The first and third ranked 
criteria for administrative promotion, namely The Degree 
Of COoperatuon Dy the Instructor with Other Staff 
Members and The Qualities of Leadership Displayed by the 
Instructor, ranked seventh and fifth respectively for 
the evaluation of instructor competence. 

The greatest difference in emphasis involved 
the criteria of The Use of Teaching Aids and Examination 
Results. (by rank) and The Instructor's Standing in the 
Community and The Dress and Appearance of the Instructor 
(by percentage). 

Of the five highest ranked criteria for evaluating 
competence, three were included in the first five listed 


for administrative promotion. 


Spearman Rho Calculation 


The Spearman rho was calculated, and was found to 
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be .90. This value suggests that there is a strong 
positive correlation between the use of all criteria 
independent of the evaluative situation; that is, the 
criteria which evaluators considered to be important 
in one situation tend to be stressed in the other 
situation and, conversely, those used less often in one 
situation tend to be of less importance in the second 
Situation. 
Emphasis Placed _upon Categories 
Of CrRUberla 

An analysis of the emphasis which evaluators 
placed upon each of Mitzel's categories of process, 
product, and presage criteria when evaluating instructor 
competence is presented in Table 10. This table was 
derived from Table 5 (p. 66) and is dependent upon 
the categorization of criteria presented in Appendix B. 

Analysis of Table 10 shows that Arete 
placed the heaviest emphasis on process criteria and 
the least emphasis on product criteria when evaluating 
instructor competence. This finding coincides with 
that of Moore (1966), Thomas (1969), and Rogers (1970) 
who found that both inspectors and principals emphasized 
process criteria and de-emphasized product criteria in 
the same situation. 

Table 11 analyzes the emphasis placed upon the 
three different categories of criteria when evaluating 


for promotion to an administrative position. This table 
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87 
refers to Table 6 (p. 72) and to the grouping of criteria 
presented in Appendix B. 

Evaluators placed the most emphasis on presage 
criteria and the least emphasis on product criteria 
when evaluating for administrative promotion. This 
finding again agrees with the findings of Moore, Thomas, 
and Rogers. 

It was concluded that process criteria were 
stressed for evaluation of instructor competence, but 
that presage criteria were considered to be most important 
in the evaluation of instructors for administrative 


pizembt ons 


Results of Factor Analysis 

A factor analysis of the data was carried out 
to determine whether there was any clustering of 
criteria into groups. When an absolute value of .40 
was used as the lower limit of significance, it was 
possible to identify at least six out of ten criteria 
for instructor competence, in each of three categories 
(produce: process, and presage). The results are 
listed in Appendix C. 

Factor analysis of the data resulted in no 
distinctive clustering of the criteria for administrative 
promotion (see Appendix C). When a four factor analysis 
was made of the sixty criteria, the thirty criteria for 
administrative promotion all clustered in one group and 


the thirty criteria for instructor competence again 
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88 
separated into three distinct categories which could be 
identified as Mitzel's categories of product, process, 
and presage. 

Moore suggested that his thirty criteria were 
evenly distributed over Mitzel's categories of process, 
product, and presage criteria. Both Thomas (1969) and 
Rogers (1970) performed a factor analysis of their data 
and found that there was some clustering of the thirty 
criteria into three groups. 

The results of the factor analysis in this study 
strongly suggest that the three clusters of criteria 
used, may be validly considered to meet Mitzel's 
characteristics of process, product, and presage categories 


when used for assessing instructor competence. 
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Chapter 6 


RELATIONSHIPS BETWEEN CERTAIN EVALUATIVE CRITERIA 


AND CHARACTERISTICS OF RESPONDENTS 


One of the purposes of the study was to determine 
whether any Significant relationships existed between 
specific criteria used by evaluators and six personal 
and professional variables. The six variables were as 
follows: the evaluator's administrative position in 
the college; length of experience in this administrative 
position or a comparable one; the amount of time the 
evaluator is engaged in classroom teaching; the length 
of the evaluator's teaching experience; the age of the 
evaluator; and degrees and diplomas held by the evaluator 
(see Appendix A). 

The original response categories of the six 
variables were retained. A chi square test was performed 
to determine differences, which were accepted as being 
Signimicang at the .@5 Teveimor less. Signi icane 


differences were found in thirty instances. 


Administrative Position 
Table 12 shows that significant ‘differences 
existed between the categories when responding to 


three criteria in each of the two evaluative Si haaclons . 
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The administrative categories were as follows: 

Meme OOrdi nator esupervisor, librarian, 
LnSiGruetOrkelOl Chief lnstructor 

2. Department head or program head 

3. Division director or division chairman 

4. Assistant dean, associate dean, dean, 
registrar, assistant administrative officer, assistant 
principal, vice-principal, or principal. 

In evaluating instructor competence, department 
heads or program heads indicated the use of The Dress 
and Appearance of the Instructor as a criterion “always” 
Or “Erequentiy Me more: than any iother category; division 
directors or chairmen indicated less use of the 
criterion of The Training of the Students in Self- 
expression than any other category; categories three 
and four used the criterion of The Instructor's 
Standing with the Students more than the other categories. 

When evaluating instructors for promotion to an 
administrative position, categories two and three used 
the criterion of The Instructor's Knowledge of the 
Curriculum more than the other categories; all categories 
indicated extensive use of the criterion of The Degree 
of Cooperation by the Instructor with other Staff 
Members but categories three and four tended to use 
this icriterion “always,” more than the other categories; 
division directors or chairmen tended to use the 


criterion of The Professional Activities of the 
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Instructor more than any other category. 
Length of Experience in this Administrative 
Position (Table 13 

It was inferred from the data that for evaluating 
instructor competence, category one (less than five years 
of experience) used the criterion of The Dress and 
Appearance of the Instructor least; evaluators with eleven 
to fifteen years of experience in the same administrative 
position tended to use the criterion of The Attitude 
of Students toward Self-Conduct and the criterion of 
The Students' Clarification and Recognition of Values 
far more than the other categories. 

For administrative promotion, evaluators in 
categories three and four tended to use the criterion 
of Examination Results and the criterion of Lesson 
Preparation and Planning more than evaluators with ten 
or fewer years of experience, who felt that these 
criteria were considerably less important; evaluators 
with less than five years of experience in the same 
administrative position used the criterion of The Use 


of Teaching Aids less than any other category. 


Age of the Evaluator (Table 14) 


When evaluating instructor competence, evaluators 
over fifty years of age indicated the use of the 
Criterion of The Dress and Appearance of the Instructor 
more than younger evaluators. 


For administrative promotion, evaluators under 
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thirty years of age used the criterion of The Dress 
and Appearance of the Instructor and the criterion of 
Use of Teaching Aids considerably less than older 
evaluators; the criterion of Academic Qualifications 
was used least by evaluators between the ages of 


fifty-one and sixty. 


Time Spent in Classroom 
Teaching (Table 15) 


No significant differences were found between 
the amount of time spent in teaching and the use) of 
the thirty criteria when evaluating instructor com- 
DECEMCEes 

When! eVakUating instructors for promotion £o an 
administrative position, evaluators who are not engaged 
in classroom teaching used the criterion of The Instruc- 
tor's Knowledge of the Curriculum less than any other 
Category; the criterion of Provision made for eee vekeee 
Differences was used least by evaluators who spend less 
than twenty-five per cent of their time in classroom 
teaching; the criterion of The Instructor's Standing in 
the Community was used most by evaluators who are not 


engaged in classroom teaching. 


Length of Teaching 


Experience (Table 16) 


No significant differences were found between 
the categories and their use of criteria for evaluating 


instructor competence. 
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For administrative promotion, the criterion of 
Class Management was used extensively by all categories 
but less by evaluators with less than five years of 
teaching experience; all categories used the criterion 
of The Degree of Cooperation by the Instructor with 
Other Staff Members either "always" or "frequently" 
but evaluators with five to ten years of teaching 
experience tended to use this criterion "always" more 
than evaluators with fewer or greater years of teaching 
experience. 
Degrees and Diplomas _ held 
by Evaluators (Table 17 

This variable accounted for more significant 
differences (nine) than any other variable. Seven of 
these differences were inferred from the use of criteria 
for evaluating instructor competence. The categories 
were as follows: 

ibis) Lud 

poe Mo Ed., Ed. Di PhD. in, Education Gr comparabie 
degrees in education 

3. HB. Ed. plus another degree ts) nobain 
Education 

4. One or more degrees but none in Education 

5. Diplomas, certificates, and other comparable 
credentials. 

Whenlievaluating imstructorn competence, the 


criteria of The Dress and Appearance of the Instructor, 
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The Checking of Written Work, and The Attitude of Students 
to Authority were used much more by evaluators in the 
fifth category than in the other categories; the 
evaluators in category two used the criteria of Class 
Management, Concern with Character Development of the 
Students, and Qualities of Leadership Displayed by the 
Instructor much less than evaluators in the other 
categories; the criterion of The Use of Teaching Aids 
was used more by evaluators in category one and category 
five than by evaluators in the other categories. 

For Administrative promotion, the criteria of 
Examination Results and The Use of Teaching Aids were 
used more by evaluators in category five than by evaluators 


in the other categories. 


Summary 


Two-thirds of the significant relationships 
found, existed between the use of certain criteria 
and the following variables: administrative position 
of the evaluator, years of experience in this position 
Or a comparable one, and degrees and diplomas held by 
the evaluator. While this last variable accounted 
for nine of the significant differences found, a 
further analysis would be needed to determine whether 
the differences are attributable to the degrees and 
diplomas held by the evaluator or to the adminis- 
trative position of the evaluator in the college. 


In previous studies carried out by Thomas (1966 ) 
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and Rogers (1970) fewer significant differences were 
found between the use of certain criteria and the 
personal and school data variables. In their studies 
the only administrative position involved was that of 

a principal of a secondary school In GHisNstudy, where 
evaluators held positions at varying administrative 
levels, the use of certain criteria would be determined 
to some extent by the proximity of the position to the 
level of instructor and by the use or non-use of 
Classroom observation of teaching performance as a 


method of evaluation. 
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Chapter 7 


ANALYSIS OF ADDITIONAL CRITERIA USED BY 
RESPONDENTS WHEN EVALUATING IN 


BOTH EVALUATIVE SITUATIONS 


Introduction 

Space was provided on the instrument (see 
Appendix A) for respondents to list criteria which they 
would use when evaluating instructors, but which were 
not included in the list of thirty criteria to be scored. 
Respondents were asked to indicate whether they would 
use each of these additional criteria "always" Cae 
PErequently sh) ,..0r, , seldom, (S). 

Forty-four per cent of the respondents listed 
additional criteria for the evaluation of instructor 
competence. Thirty-eight per cent listed eddtt1onal 
criteria which they would use when evaluating instructors 
for administrative promotion. It was concluded that 
evaluators in community colleges use many criteria in 
addition to those included in the instrument for both 


evaluative situations. 


Techniques Used in the Analysis 


Two techniques were used in both evaluative 


situations to analyze the additional criteria. The 
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criteria were arbitrarily weighted according to use as 


£011 0ws: 
1. “always” -- 5 points 
Come OCU nhs Mesa ee OLS 
Sa celdom -— 91 point. 


They were then categorized on the basis of a classi- 
fication scheme ees by Barr (1948) in his analysis 
of studies related to the measurement and prediction 
of teaching efficiency. Barr's’ (1948) classification 
scheme involves breaking down characteristics of 
teaching efficiency and its prerequisites into five 
different categories: personal qualities, expected 
competencies of the teacher, desired student outcomes 
(or effects of teacher leadership), behavior controls 
such as knowledges, skills, interests, attitudes, and 


ideals, and a collection of background personal data. 


Additional Criteria Used _in Evaluating 
Instructor Competence 


Melaistinglof additional criteria used by 
respondents for evaluating instructor competence may 
be found in Appendix D. They are listed in the same 
orders acitthey appear im@able 18 to facilitate con- 
venient reference to categories of criteria. 

Table 18 lists the criteria by number and 
weight (in parentheses) according to Barr's categories. 
Weighted scores for each criterion and for each category 


of criteria are included. It was found that the category 
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Table ws 


Categories of Additional Criteria Used by 
Evaluators in Community Colleges When 
Evaluating Instructor Competence 











Gross 
Category* Weighted 
Score 
1. PERSONAL QUALITIES 
Tee Drgves 016) 44 231 SpheSO (oe 4 301 5)6) 4115) 4 
Advan. 45(5)5 4/(5)% DOCSIS Syd bys /445) 5 
99(5), 149(5), 205(5), 226(5), 249(5) 76 
2. Resourcefulness4)3(3)pe4(3)4.5(8), 2145); 
De) a5 3545) 2 644 (55s 20145) 76215) * 
Cote RY 14415 )ay L0G p ee 21105) 5 ) 24045) = 
245(3), 246(3) 73 
3 Cooperativeness, 19G@)me 26,3) ,<31 (5) 
90ie)e 410315) 54115 conmelse(3)-\ 1475); 
157(5), 158(5), 182(1), 188(5), 216(5), 
255(5), 263(3) 61 
4. Reliability 63(5), 70(5), 97(5), 101(5), 
107(5), 131(5), 203(5), 239(5), 260(5) 45 
De bUOvency = 52 (3) P57 reel 5o105) 5. 207(5), 
ZI 5) 23 
6.1 Personality (general) 40(3),,134(3), 
N58(5)14229(3) 14 
7. Dominance 6(5), 68(3), 106(5) ee 
8. Considerateness 30(5), 171(5) 10 
9. Intelligence 168(5) 5 
10. Emetlonal Stability eerss 5 ) 5 
11s Attractiveness °172(5) 5 
12. Refinement 175(5) 5 
*AGCord ing) £0, Barre (1946). *) (The?’numbers repre- 


sent the criteria listed in Appendix D, with the 
weighted score shown in brackets. ) 
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Table 18 (continued) 





Gross 
Category Weighted 
Score 
i3  BObgectivibyel125(3) 3 
338 


II. COMPETENCIES (abilities to do) 


le ASgandtLectomeon leabhung 5163)5 76373 
eto) TOt oye 1o(5)y14(5) 15(5),. 16(3), 
tg) Calo) 51(3)485e(3), 6665),67243), 
7oUS). whee), SOMSIe 8565) 4486650708 7(5), 
Ou oie 241 9015) 9910215), 10515), 
MOS er O9 (GN) Slots ee 2115 ))112(5)5 
To ee on als 7) 41h) eh 543) e 
159(5), 165(5), 166(5), 179(3), 180(5), 
615). 918305), 18445), 189(5), 192(5), 
198(5), 204(5), 206(5), 208(5), 209(5), 
Pete ee 14 e200 01 5) 223(3), 
295 (5) 231 (Sees? (519 242(3),-4244(3)} 
257(3), 259(5) 276 


2, sAceagmenbeneorea proression 25(5), 78(5), 
Os et 1 >) i ( ) 210(5).,. 23715), 
225 (5) 40 








TII. EFFECTS OF INSTRUCTOR LEADERSHIP (results) 
Wee rens (Sema Co liao. soe Co )F 
ue 40 (5 )e ol (ol 6e(5) 5 519003), 
eV Shey Alen Gaya eeu es))| 59 











IV. BEHAVIOR CONTROLS 


1. Skill in communication (verbal and 
marotennes4(5))5)149(3), 59(5), GO(S), 
6405) 706905 yee7(5)-9418(5), 12315), 
ieacoyeiD7 40599 9177(5); 178(5), 219(5), 
22545) 25605) 78 


QeeProrcess Onal, actitudes — /4(3), 79(1), 
SZC 95°73) 98 (5 )-94b39(3), 160(5), 
GeO 5.9515), 20105) 22405) | 230(3), 
251(5), 253(5), 256(5) 63 
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Table 18 (continued ) 
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3% 


14. 


Gross 
Category Weighted 
S Cores 

Efforts toward self-improvement 28(5), 

52 oomeoo (5) oar Sener oo (3) 490805), 

Pees eeeto5 (3) eee Wee 22213), 3234(5), 

Pes Sie 23.8 >)" 252,(3)) 58 
Knowledge 20(5), 55(5), 127(5), 130(5), 

142(5), 167(5), 197(5), 233(5), 243(3) 43 
Ski lieen niman relarvonsnaps §2(8), S6(5), 

Be (eee 9 (5) eae enn 125(3)) 200(5)i, 

met 3) 30 
Enthusiasm for instruction 170(5), 186(5), 

2505) I5 
Workenabits. §140(5)5m1O3(5), 23615) 15 
@Ceneralmeki lis 2905) 9(3), 13203), 146(5) 16 
Interest in preparation of course outlines 

12(5), 196(5) 10 
Interest in students 150(5), 217(5) 10 
ineeresten (general )eise (5). 9137(5) 10 
Extra-curricular activities 54(3), 84(3), 

191403) 9 
Empathy with young people 124(5), 250(3) 8 
Attitude toward change 37(5) 5 
Performance under stress 57(5) 5 
Health 126(3) 3 
Citizenship 176(3) 3 
Instructor requests 227(3) 3 
Internal economics 264(1) u 
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Table 18 (continued ) 











Gross 

Category Weighted 

pConres 
20. Administrative pressures 265(1) i 
386 








V. STATUS FACTS 
Pees OS) A478 (5), MNRTS)s, 4:2.8:63)) sek45-05)5 
a Nemec (5701 7315 )eeee ts), 248(5)4 26215) 56 
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of Behavior Controls weighted the highest. The category 
of Personal Qualities weighted the second highest and 
Competencies of the Instructor third highest. Much 
less used categories were those of Effects of Instructor 
Leadership and Status Facts. 

In the category of Behavior Controls, the 
Criteria ranking highest were Skill in Communication, 
Professional Attitudes, Efforts toward Self-Improvement, 
Knowledge, and Skill in Human Relationships. In the 
category of Personal Qualities, Drive, Resourcefulness, 
Cooperativeness, and Reliability were considered the 
most important qualities. 

In the category of Competencies of the Instructor 
were included the following items: 

A. Competencies as a director of learning 

ie) SKHl1 in identifying student needs 
2. Skill in setting and defining goals 
Boeeckinl tn pEovraung £Or andiavidual 
differences, in making activities meaningful, and in 
Organizing experiences into meaningful wholes 
4. Skill in instructor-student relationships 
SeePckLlivdn appraising student growth and 
achievement 
6. Skill in instruction (general) 
B. Competencies as a member of a profession. 
Included in the category of Effects of Instructor 


Leadership were student assessment, effectiveness of 
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teaching, specific accomplishments during the year, and 
records of student achievement. Included in the 
category of Status Facts were training, experience, and 
specific original accomplishments. 

In their additional criteria for evaluating 
instructor competence, evaluators in community colleges 
placed great emphasis on personal qualities of the 
instructor, competencies of the instructor, and 
behavior controls. Little emphasis was placed on the 


results that he obtains and status facts about him. 


Additional Criteria Used Hla 
Evaluating for Promotion to 
An Administrative Position 

A list of the additional criteria used by 
evaluators when evaluating instructors for promotion 
to an administrative position may be found in Appendix 
D. Several respondents indicated in their comments 
that either there were no procedures for instructional 
staff obtaining administrative positions in the college 
or they were not involved in evaluating instructors for 
administrative positions; however, they still answered 
the questionnaire on administrative promotion on the 
basis of criteria they would use if they were in such 
an evaluative position. 

Two hundred and twenty-four additional criteria 
were listed by respondents. Once again many of the 


criteria were repeated. The same techniques were used 


to analyze these additional criteria but Competencies 
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as Administrators was substituted for Competencies as 
Instructors in Barr's (1948) classification scheme. 

Table 19AIg¢sts theladditronalicriteria by 
number (see Appendix D) and weight (in parentheses) 
according to Barr's classification. The main emphasis 
was placed on Personal Qualities and Behavior Controls. 
Competencies as Administrators ranked third in importance 
with Effects of Instructor Leadership and Status Facts 
receiving little emphasis. 

Of the personal qualities, Reliability, Drive, 
Resourcefulness, Intelligence, and Cooperativeness were 
considered most important. In the category of Behavior 
Controls, Professional Attitudes were accorded the 
highest weight. Other criteria in this category con- 
sidered to be of importance were Skill in Human 
Relationships, Communication Skills, Efforts toward 
Self-Improvement, Work Habits, and Performance under 
stress. 

Competencies as Administrators included skill 
in the following areas: 

iis Organization 

2. Planning 

3. Supervision 

4. Management 

34 Delegating authority 

6. Decision making 

7. Administration 

In their additional criteria for evaluating 


instructors for administrative promotion, evaluators 


in community colleges placed great emphasis on personal 
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Table 19 
Categories of Additional Criteria Used by Evaluators 


in Community Colleges When Evaluating for 
Administrative Promotion 


— ns st 
ee ee ee ee 





Gross 
Category* Weighted 
Score 
I. PERSONAL QUALITIES 
1. Reliability 10(5), 46(5), 53(5), 65(5), 
Be 5)e 6 72(5) 785), Bal Ses 12315)! 
LIM 59%" 1491 507 168 ( 590 1 721595 178159) 
EOS (3) 73 
2-Drive 54(5), 59(5), 81(5), 89(5), 105(5), 
106(5), 128(5), 159(5), 161(5), 168(5), 
TOOK 5), 193 (5)%" 2101577" 22015) 70 


S-eReeOuUrcerulness: 11(5)))l2(3)537(5), 39(5), 
AA) picuiconye 70(5), 122(5), 141(3), 146(5), 
doe(5), 164(5), 177(5)) 6214(3) 64 


4. intediigences \5(5),— 20 (aoe 64 (50.5 73.(3)5 
118(5), 144(5), 151(5), 190(5 ), 194(3), 
20315) 46 


Smee over an veness — 14s )pel7 (5) 18(5). 3113), 
62(5), 80(5), 92(5), 137(5), 191(5), 201(3) 44 


Gs Personal ityed generaijre 63 (5). 786(5).e157(5), 
179(5), 182(5) 25 


7s@Cansiderateness, . 1915)... 49(5,),..147,(5),, 195(3) 18 


So. Buovency g752(5), Jv/olb), L8a(5), 196(3) 18 
9 4Emotdonal stability; -1305,).,..1315(5)...135{5) Re. 
10; Dominance 915(5), 16€595 133(3) 12 
11. Objectivity 116(3), 130(5) 8 
12. Refinement 150(5) 5 
13. Attractiveness 148(5) __ 9p 

404 








*According to Barr (1948). (The numbers represent 
the criteria listed in Appendix D, with the weighted 
score shown in brackets. ) 
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Table 19 (continued ) 
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Gross 
Category Weighted 
Score 


a ee ee ee 
—_ ee eee Se ee ee 








SN IS a a re 





TD sCOMPHEENGTES €((G@bilities todo) 21(5), 22(5), 
PG eee no) 8 -28(5))) 3238 eo). 36 (5), 
Al (ep tao Gan) oie) eiool opm (3)5.76(5), 
Soman moO 5), 91 (5) oe (oR LOO (>), 


OLD LES On\( Saice OS) SID) | 12.2(5), 

tevin emi 3 05 )) 140 (5 peel (oem a0 0D), 165(3)), 

06,7 (nee ee04-G5s) er85,(5) peel 8 7205079 189(5), 200(5), 

PO Cee 06 (5) 20905) yale > pw 7 (5). 219(5) ees 
198 











III. EFFECTS OF INSTRUCTOR LEADERSHIP 3(5), 4(5), 
9(5), 29(3), 58(5), 94(5), 166(5), 199(5) 38 








IV. BEHAVIOR CONTROLS 


Jee oress1 Onal atti tudessmma ones 435). GOC3), 
PAG5 M15 (5), 7705)e 5315), 988), 102(5), 
108 (5)p) 109(3)., W295 ees 2(5)) 14005 )., 
156(5), 169(5), 174(5), 183(5), 186(5), 
COs S)pg223 (5) 95 


N 


Skiiis in human relationships 3/(5), 6(3)., 

Hos 935) 126 (aes (5 545), 

(6 5 (5) Leo Ua mil (5) 215 (5), 

221 (5-) 63 


3. Skill in communication (verbal and written) 
sici(Gy LAA e sen Gy) S2Cc TSN Gem in Me ORCs i 
E45 (3), 70 Coys ISAS) I) 198(5) 44 
4. Efforts toward self-improvement and develop- 
Ment Of Statt membegsm4 (55 26(5),912913), 
do¢3), 225), 2a yee 43) 29 


SEO ab lcs 6203) 5 oo) oro) Sd Le esa 
120(5), 138(5) 28 


6. Performance under stress 38(5), 45(5), 
Bio) SC), 104 (seein (3) 28 


y AROW Ledge 4003 esto), 124(5)5 17115) 18 


Ge Positive dttrtude 160(5), 204(5) 10 
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Table 19 (continued ) 
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Gross 
Category Weighted 
Score 
Oo Health. 6(5) 5 
10. Enjoys administrative work 155(5) 5 
Ri, GPoltticel awarenessi1e95(5) 5 
i) POLE =Campuseactivities* 45761) D 
351 








STATUS FACTS 
Pe ems Ores eS (3 aero (59 eal )e 9131 (5) 
136 (Sipy 207.65 sey2 22 (dr) 37 
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Les) 
qualities and behavior controls, some emphasis on 
competencies as administrators, but very little 
importance was attached to the effects of instructor 


leadership or status facts. 


Summary 


Additional criteria used in both evaluative 
situations placed very little emphasis on the effects 
of instructor leadership or status facts. These 
findings add weight to earlier conclusions that product 
Criteria are generally of low prioity. 

The category of Competencies ranked third in 
importance in the additional criteria used for both 
evaluative situations. in evaluating instructor 
competence, Behavior Controls received the greatest 
weighting while in evaluating instructors Cor adminis- 
trative promotion, Personal Qualities ranked first. 
Competencies as an Instructor was given considerably 
more emphasis than Competencies as an Administrator. 

In both evaluative situations, respondents 
stressed the importance of the following additional 
criteria: drive, resourcefulness, reliability, 
cooperativeness, professional attitudes, skill in 
communication, skill in human relationships, and 
efforts toward self-improvement. These findings 
corroborate earlier conclusions that evaluators in 
community colleges do use a common body of criteria 


when evaluating instructors. The similarily between 
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Criteria used in both evaluative situations is evident 
from the analysis of the additional criteria as well 
as from the analysis of the thirty criteria included 
in the instrument. The main difference in the use of 
additional criteria for the two situations was in the 
category of competencies. 

Many of the criteria included in the instrument 
were reiterated in the additional criteria. All of the 
additional criteria included in the category of Personal 
qualities were analogous to the criterion of The 
Personality Attributes of the Instructor. Many of the 
additional criteria classified as Competencies (as a 
director of learning) were identical to the criteria 
of Provision Made for Individual Differences, The 
Methods of Lesson Presentation Used, Lesson Preparation 
and Planning, Instructor-Student relationships, and The 
Enthusiasm displayed by the Instructor in Teaching. The 
additional criteria classified as Professional Attitudes 
and Efforts Toward Self-Improvement were similar to the 
criterion of The Professional Activities of the Instructor. 
Tt was concluded that the use of additional criteria by 
respondents which were identical or similar to criteria 
included in the instrument was indicative of the 
importance they attached to these criteria when evaluating 


instructors. 
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Chapter 8 
EVALUATORS’ COMMENTS ON THE STUDY 


All respondents were invited to comment on 
any aspect of personnel evaluation and/or the study. 
Nearly thirty-eight per cent of the evaluators made 
such comments. They varied in length from one sentence 
to more than a page. Because of the large number of 
comments (93), only a few have been included below; 
they have been reproduced as originally written, although 
in many cases only excerpts have been taken from 
lengthy comments. | 

The comments were categorized under six basic 
headings (see p.50 and the following detailed listings). 
The number of comments in each category are listed in 
Table 20. Although many comments could be classified 
in more than one heading, the categorization was based 
on the predominant theme of the comment, with the 
following exception. If the comment included any 
criticism of the instrument or study, it was classified 
under the heading, Criticism of the Instrument. Forty- 
six out of ninety-three comments included some critical 
statement, but in most cases these comments included 
additional valuable information. The large number of 
comments is indicative of the extent to which instructor 
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Table 20 


Comments by Category and Frequency 





Category Prequency 
1. General reaction to the instrument 8 
2. Criticism of the. instrument 46 
3. Methods of evaluation used 9 
4. Selection of administrators 4 
Seer ucer ta 6 


6. General comments 20 
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evaluation is perceived to be of vital concern to 


community colleges. 


General Reaction._to the 
Instrument 


A comparison of the two lists of "30" seems to 
indicate that the architect of the questionnaires 
feels that the qualities that make a good instructor 
also make a good administrator. 


The assumption seems to be that evaluation is an 
individual thing done by a supervisor. I feel that 
student and graduate evaluation of instructors 
should play a large part. 


Evaluation of academic staff holding library positions 
involves evaluation of situations ranging from the 
formal classroom situation (e.g. orientation lectures) 
to the more frequent informal interaction with 
students at the individual instructional level as 
well as interaction with other faculty and staff. 
Therefore, the factors checked in the questionnaire 
have been. interpreted as they relate to the library 
situation, and imply a broader definition of the 
competence of the individual as an educator than 

the classroom situation may embody. 


Most of the factors listed are valid. Thus they 
should always: be considered. In evaluation of 
the instructional performance, a supervisor must 
consider the whole person and the overall 
contribution. Many of the factors listed will be 
comsidered directly--others only indirectly. A 
much more difficult question is the weighting to 
be given to various valid factors. 


Perhaps it would be advisable to differentiate 
between levels of administration in the second 
questionnaire. 


Those points concerned with student self- discipline 
and character, etc., are important but not as 
relevant to the college situation as to high school. 
Many of these points are difficult to measure; in 
mslele “ieintemslarepalsinmerg measureability differs and the 
points listed are by no means of equal weight. 


It has been quite enlightening to compare the 
responses in the two Situations. 
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Critiveism ‘ore the Instrument 


Study 2 should have had some different questions. 

A good instructor is not necessarily a good adminis- 
trator and vice versa. To administer a college 
requires more acumen when dealing with people than 
an instructor has to possess. A good administrator 
Cannot simply be a good example because his instruc- 
tors do not perform the same tasks. His qualities 
are thorough understanding of human relations, 
enthusiasm about his work, a good sense for 

business transactions, the willingness to ask for 
advice, weigh it, and finally make a decision which 
is his own and which he defends without vacillating. 


Based on questionnaires in section two, this is 
academically oriented and does not take into 
consideration one of the largest group areas in 
a community college. 


Many of the factors listed involve actual classroom 
visitation. Since this is not the case at our 
college, much of this form is inappropriate. In 
addition, many of the questions refer to the same 
things and are repetitious. Thus you may find a 
general factor listed as "always," while some of 
the factors which make it up may be marked "seldom" 
or "never." 


The different connotations possible in most questions, 
the variety of programs being considered, and the 
generality of most questions make it possible for 

the researcher to arrive at any conclusions he 

may desire. 


Some of the questions are vague. For example, I'm 
not as concerned about actual examination results 
as what the instructor does about them. 


Naturally I favor an objectives approach and some 
desire to work toward individualized instruction. 

A pedagogical background plus supervisory experience 
are main concerns for ‘administrative positions. We 
have found a good administrator does not require 
specific or detailed knowledge of curriculum unless 
in foreman or first line supervision. I would have 
used a much different questionnaire. 


The attitude of students to authority is unclear. 
It does seem to relate to the other questions. The 
students have many instructors--one cannot be held 
responsible for their entire attitudes. 


OL Lf 



















.anottespp tnsisttirb smoe bet 2 
~eisnimbs boop 5s Vilisessoon t0n 
apalion s reteinimbs of ae 

dv sigosq diiw pri tésb nae 3 
10setd EER boop A «sease 

-~yiudaot ara Bahoot! old 

eoltt Lettp %eth . 2btes) shes 
,anolisier msm 20 Bal 


see 
far 
10% Sense Boop 6 eh suOd« mee tage 
10% Abs Of dasnonlt how yor egater edentaud 
dofirw aiierosh’s sane va beet, +E eee > ; 
.pnissllingy tuodsiw’ 26ne%sb 


at aids ows nodsyen at asiisn 
oe = 

Otte ost t0n 29°b bné bear . 
Mi 26526 quotp Jespted “ora: ae 


moozra@esio [6ydg26 svioveet betelt,’ 
10 36 9260 SHI don ats 
nt .s3stmqoiggsat) £1 \ipxot 2@ 
omée oft oF 19tst anolse Sts 
ants yom ory ardT BuO RP ES 

to emoa stiftw “ ayewise" ope Bee 10706 
‘mobfoe" bexzem sd vem qu +2 salem Sete e3o75e2 ent 


=f 
oie | 


enoitasip seom nt sidiaeoq ancitesom 
oft bas ,bsxasbianoy pated smapag 

10% afdizeog +i eXism enoigesup 
oi etfotfevionos vir Js sve 


m'T ,siqnises tO% s6Upevy Sb | 
a+ heey rotten timex laudos 
aginst yuods aso0Bb 


emoe hak septienals Pint Sere 
Sopaen Saat 








i? 


There are many factors not included in the question- 
naire which differentiate between administrative 
competence and instructional competence. 


You have allowed no space for business skills which 
are usually most desirable in addition to a 
thorough understanding of instructional principles. 


The questionnaire seems to have been made up for 
a pure academic without consideration for the 
possibility that the instructor may have a wealth 
of practical and business experience in his field. 


Many questions seemed to apply to efforts of the 
students which are not always within a teacher's 
control in a college situation and/or which would 
be difficult for an evaluator to gauge. 


Seems to be directed more at secondary school than 
post secondary. 


This questionnaire does not even list the key 
criteria used by me in selecting, evaluating, or 
recommending my staff. 


Methods of Evaluation 


To evaluate staff validly, criteria must be laid 
down and agreed to by supervisor and staff member. 


Our faculty are evaluated on the basis of (1) student 
evaluation--we consider the student opinion is 

valid and reasonably honest, (2) peer group eval- 
uation, and (3) attitude and participation. 


Work loads do not permit enough time to be devoted 
to analyzing the success of programs and instructor 
competence. Possibly a team teaching approach 
could be considered periodically with each team 
member evaluating his counterpart in a series of 
similar classroom and field situations. In field 
oriented engineering subjects, evaluation of the 
instructor's competence presents some problems. 
This evaluation at the technical level is far more 
important than analysis of classroom activities 
and requires far more time. 


The civil service is not evaluated in an unen- 
cumbered manner as this survey would tend to 
assume. We have to do our evaluation within a 
rather strict set of rules which are not always 
appropriate. 


































LS f 


-“noiteaup saad nt a tom 4 ei0ds 
oN tienda bade naswted octedt 
» S0onSetaqmoa Ieno kaa 


foidw alliae sesmteud io3 
os in (tO f ej i} bd f= a elder. — 
-2eiqtonbiq Isnatsousteat ae pal Uhh east 


- Z 
- MM 


i ou Siam nf rt IVEti 0 + entege, et benno i FAP. “i aN 
ei3j tot aottstebitedoo Ano thw oimebsos 3 sq f 

fitlssw 4 Sovi rf Ven “Odo + sent ott et? yok tiie rat 

etd wi sonnets to “eeombend £8 ferisossq, 


Qty or ; 
| ae Yi 
ant to 235° O27 ] Og YLags. ot nalts, -anokteoup “ ; 
b> '+onpeat 5 riod iw ey f seas ton. St5 doidw a sp cian 
bivow foirw so\brs Aortevtita epsilon 6 mi Loxsne 
»- SOU BD qe nett JS. x07 Hino? th = 
“4 


; 7 
aned+ Loodose yiebnesse 26 sion | peda. ed ot ames? - 
) <¥pshnoose: ya0g aa 





you std dell neve Jon eases etisones sasnp mist 
omits lieve pnbtvebee ak Sit gel Bese sitetizD 
) ; «ae ms oP ‘on tbnemmoos1 


‘gbisieu tev: 20 


an 


ae Gis } 7 te i" 
bisi ad steanm sirwedia Sas ‘Fisse sisuisyvs oT 
rodmoamn Steca base 70d f v rege ot beer. & nines awob- 
; i ah ~ 


rnobude (0) 20 afesd ett ae © sisuisve Ba6 ytfuost wo 
i noindgo. trebuste srs i Bw-~notseu Lene 


~ieve quoxp 168q (S) ,casaon” nossa: brs bitev 
MO Lt6qLoLIiseG bas sbud i pe) ris meer _ 


bovoveb od od semis dpvons timed som) bh absot x08 
wioutient Baa esa ges 50 aegIOUe it pnisyisns ot | 
fseoxggs poidoss) mbes & vide oc Rectal cigs i > 
meso toss Adie yilsotbo tired bs sins erioc. ad &! ae 
ar ee 





10 esrvwes 6 ml dusqtetavoo ain) pn itp teve t: 

bloity nl  .enotdseucia pied "end Qo1e ts LD iat. 
eit 20 Meicerleve.,edostduve full @ oot) 

. ame (doxd anos eingesiq 989 tax 

sion wt ef tavel fevtndses | ach 

asivivitos moO TERE Lo: to &. 






1 a 


Evaluation of instructors should involve students 
(through written evaluations and earefully con- 
structed interviews), peer evaluation, and adminis- 
trative evaluation (which is the least important). 


Personnel should be evaluated in a positive manner 
at least once a year. Evaluation should be 
discussed freely before being formally submitted. 


Formalized recorded evaluations are unnecessary-- 
largely a waste of time and are too detached from 
the individual concerned. Evaluation is on-going 
and can be tapped when required by the more personal 
method of interview. 


The evaluation of staff is completed in any one 
day which may be an "off" day for the instructor 
or the evaluator. This leads to biased reports. 


At the moment we do not engage in classroom 
visitations or in tight supervision or direct 
assessment of faculty. The questionnaire assumes 
that some form of direct supervision and assess- 
ment takes place and is reminiscent of a high 
school situation. Our instructors are given much 
more freedom to innovate, develop courses, and 
curricula. Assessment is dependent in part on 
negative feedback’ from any quarter. 


In our program, the clinical instructors are 
situated in places remote from the institute. 

They are, in most cases, the only members of the 
Department of Education in the area and must work 
independently. They are visited on a rather regular 
basis for approximately a week at a time (about 

3 to 4 times a year--oftener if necessary--problems 
or new instructors). 


Selection of Administrators 





The selection of both teaching and administrative 
personnel should be done by committees of adminis- 
trators, faculty, and students (above second year 
institutions). 


A "good" teacher usually leads to a "good" adminis- 
trative man. 


This college has no procedure for a faculty member 
to become an administrator. 


The qualities which make a good administrator are 
not necessarily the same as those which make a good 
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instructor. The result of this kind of evaluation 
is to place your master teachers in administrative 
positions and leave the lesser teachers in the 
Classrooms to do all the actual teaching. 


Criterva 


All evaluation ‘should"be™based only on the stated 
objectives and responsibilities which the employee 
is expected to meet and the method which is to be 
used in their achievement. 


Too many people are rated according to how they 
conform to an established system rather than on 
the strength of their abilities and potential. 


Evaluation of instructors depends on many things 
and what may be right for one department may be 
entirely wrong for another. 


Ae chatimacvers ie the -overal lM rmpact “or ©alt ‘these 
factors on the student; that is, are the students 
enthusiastic about the class and are they learning 
something. 


The only difference in evaluation I would use between 
instructor and administrative competence would be 

in regard to organization, inter-personal relation- 
ships, and innovative leadership. 


The elements of evaluation must coincide with the 


specific course objectives and the characteristics 
of the student population. 


General Comments 





Department heads have neither the proper amount 

of time available or the training required for 

proper evaluation and assistance. They do have 
Knowledge and control of subject content and changes 
and these tasks take up most of the non-instructional 
time. This leaves little time for professional 
development. 


My responses in questionnaire two are based not 
on experience but rather on a consideration of 
those factors that I think I would stress if I 
were placed in an administrative position. 


Are you not interested in how I gain insight into 
an instructor's teaching techniques, student 
relationships, etc.? 
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I do not evaluate instructors for administrative 
promotion so I didn't complete the second 
questionnaire. 
Our students seem very concerned with the credibility 
of what the instructor is teaching. If the instruc- 
tor 1s able to relate the theory to actual practice 


which he has experienced, his theory is much more 
acceptable to the student. 


Summary 


The comments were an important contribution 
to the study. They were not restricted solely to 
Criticisms or general reactions to the instrument. 
They revealed the many different instructional 
Situations in community colleges, methods of evalu- 
ating instructors, the need for criteria relevant to 
individual evaluative situations, and a diversity of 
Opinion regarding the whole area of instructor 
evaluation. 

While there is no consensus of opinion on any 
aspect of instructor evaluation, it is apparent from 
the comments that community colleges in Western Canada 
consider the assessment of their faculty members to be 
a vital function. Regardless of the methods used, the 
purposes of evaluation, and the criteria on which 
evaluations of instructors are based, if a major 
concern of the community college is to create an 
evaluative climate conducive to faculty security and 
improvement in teaching performance, the potential 
for progress in evaluation will be greatly increased. 


An analysis of the comments and the written 
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information received revealed this concern in many 


community colleges in Western Canada. 
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Chapter 9 
SUMMARY, CONCLUSIONS, AND IMPLICATIONS 
SUMMARY 


The basic purposes of the study were to 
examine (1) the purposes of evaluating instructors 
in community colleges in Western Canada, (2) the 
methods used to evaluate these instructors, and 
(3) the criteria of evaluation employed when evaluating 
instructor competence and when evaluating instructors 
for promotion to an administrative position. 

Answers to the following questions concerning 
Bhesevallatilon’of instructors were sought: Isa 
common body of criteria employed? Are the same criteria 
used when evaluating for both instructor competence 
and administrative promotion? Which of Mitzel's 
categories of process, product and presage criteria 
are stressed in each situation? Are there any relation- 
ships between certain personal and professional variables 
and the criteria employed? What methods and techniques 
are used to evaluate instructors? What are the major 
purposes of evaluating instructors? 

Two instruments were used in the study. The 


first one consisted of five items which requested 
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information regarding the methods used in evaluating 
instructors, purposes of evaluating instructors, and 
three items required for administering the second 
instrument. The sample for the first instrument 
consisted of twenty-six community colleges in Western 
Canada. 

The second instrument consisted of nine personal 
and professional data variables and two thirty-item 
questionnaires--one for evaluating in each of the two 
evaluative situations--which were made up of thirty 
criteria of instructor evaluation, ten in each of 
Mitzel's categories of process, product, and presage. 
The sample for this instrument consisted of two hundred 
and forty-six evaluators of instructors in Western 
Canada. 

Statistical procedures included a frequency 
count of the use made of different methods of evaluating 
instructors: a categorization of the purposes of 
evaluating instructors and a ranking of the categories; 
a frequency count to place criteria in rank order for 
both evaluative situations to determine if a common 
body of criteria was used in either or both of the 
situations; a factor analysis to see if criteria tended 
to cluster in Mitzel's categories of process, product, 
and presage criteria; chi square tests to isolate 
significant differences between categories of six 


personal and professional variables and evaluators’ 
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uses of specific criteria; a classification of the 
additional criteria used by evaluators according to a 
scheme devised by Barr; and a classification of 
respondents' comments on the study. 

The diusrerent vanaliyses Sof \the™datarreveated “the 
following: 

1. Community colleges use a variety of methods 
and techniques for evaluating instructors, the most 
commonly used being student evaluation, classroom 
observation, and team evaluation 

2. The major purpose of evaluating instructors 
in community colleges was to improve instruction; this 
included assistance to instructors in increasing their 
effectiveness. 

3. Evaluators employed a common body of evalua- 
tive criteria for rating instructor competence and when 
evaluating for administrative promotion 

4. There were several criteria which evaluators 
commonly did not use with high frequency in both 
evaluative situations 

5. Changes in emphasis on certain criteria 
occurred as the evaluative situation changed; process 
criteria were stressed when evaluating instructor 
competence, and presage criteria were stressed when 
rating for administrative promotion 

6. Several significant relationships existed 


between the personal and professional variables and 
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the use of certain criteria. The majority of these 
were connected with differing administrative positions, 
years of experience in the position, and the pro- 
fessional training of the evaluator. 

7. Evaluators listed additional criteria for 
evaluating instructors, many of which were analogous 
or identical to the eniterda included in the instrument. 
Once again it was found that a common body of criteria 


was used in each of the evaluative situations. 
CONCLUSIONS 


The following conclusions were based on the 
findings of the study: 

1. While the overall emphasis on purposes of 
instructor evaluation is placed on the improvement 
of instruction, there are a number of colleges in 
which instructor evaluation is carried out mainly to 
serve as a basis for administrative decision making. 
An examination by each college of its primary purpose 
in evaluating instructors might result in a change in 
emphasis - 

2. Direct sources of information for instructor 
evaluation could be used more than is presently the case- 

3. Since community college evaluators use a 
common body of criteria with consistency when evaluating 
instructors, the possibility exists that an evaluative 


instrument could be constructed, made up largely of 
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those criteria listed in the instrument and those 
additional criteria listed by the respondents which 
were commonly used. Using these commonalities as a 
basis, criteria relevant to the particular instructor 
could be added to adapt the instrument to different 
instructional situations. 

aie Evauatdion of administrators still receives 
little attention in educational institutions. Both 
instructors seeking administrative positions and 
administrators seeking different or higher adminis- 
trative posts could benefit from an awareness of criteria 
upon which their performance is based. The findings of 
this study could provide a basis for the construction 
of such an instrument. 

5. Evaluators conceived of a competent 
instructor as being one who was dependable, displayed 
enthusiasm in teaching, had a good knowledge of the 
curriculum, and maintained good relationships with his 
students. Based on the additional criteria, evaluators 
conceived of a competent instructor as being one who 
possessed considerable drive, was resourceful, 
cooperative, and reliable. Their assessment of an 
instructor waswalso based ‘on his™Sskiia in® communication, 
professional attitudes, efforts toward self-improvement, 
knowledge, skill in human relationships, and his 
competencies as a director of Tearning ~"Lewould 


appear that what students actually learn is given 1ow 
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PrLonmityee Wiis: Suggested hatuproduct>icritenia are 
deserving of a greater emphasis in evaluation. With 
objectives approach to evaluation, a shift in emphasis 
away from the person of the instructor toward student 
outcomes is possible. 

6. If an instructor displays qualities of 
leadership, cooperates well with other staff members, 
is dependable, and has a "good" personality, he is 
Hikely ito be frated highly for suitability to an-adminis- 
trative position. On the basis of the additional 
criteria used, evaluators conceived of a good 
administrator as possessing the same personal qualities 
as a competent instructor but with the added quality 
of intelligence. Their assessment of instructors for 
administrative promotion was based upon the same 
behavioral controls as their assessment of instructor 
competence but with the added criteria of work habits 
and performance under stress. 

7. The additional criteria and the criteria 
included in the instrument exhibited a high degree of 
similarity. The common useage Of many additional 
criteria was indicative of the increased weight that 
was given to several criteria included in the 
instrument. 

8. Generally speaking, the criteria which 
evaluators considered to be important in one situation 


tended to be stressed in the other situation. In both 
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evaluative situations, the product criteria were given 
low priority. This leads to the suggestion that either 
there are few valid instruments for measuring student 
Ged neasian resultrofiaunstructor,behaviors: or the 
evaluators in general are not as concerned as they 
Showbdmbe with student gains. In either case, the 
need for a change in emphasis is essential- 

SeaWhiler Gt is trues that inj some icases evalu 
ators who differed in the six personal and professional 
variables responded differently to different criteria 
(see Chapter 6), in most cases these variables had a 
limited effect on evaluators’ responses to the evaluative 
criteria. 

10. From the personal and professional data, 
it was apparent that the majority of community college 
evaluators are continually increasing their knowledge, 
experience, and academic qualifications. In addition 
to taking courses in their academic field, many 
evaluators have increased their expertise in teaching 
and broadened their knowledge through taking courses 
in instructional methodology, behavioral sciences and 
administration. 

11. From the comments, it was concluded that 
evaluators in community colleges were vitally concerned 
about evaluative criteria and evaluation procedures. 

It would appear that with continued interest and 


efforts in the area of evaluation, community colleges 
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Can contribute greatly to increasing the validity, 
reliability, and relevance of evaluative instruments. 
They may lead the way for institutions of higher 
education in pursuing objective, realistic approaches 
to evaluating the effectiveness of the instructional 


process. 
IMPLICATIONS 


The following implications while related to 
the evaluation of instructors are not based on the 
findings of the study. 

All educational institutions are being pressured 
to evaluate their staff, programs and general operations. 
The public is demanding that educational institutions 
be held accountable for the expenditure of public funds. 
Perhaps in no other institution of higher education is 
more emphasis being placed on the evaluation of 
instructor performance than in the community college. 

It has been suggested that the community college offers 
a second chance to many who have not been successful 

in other educational programs and institutions. If 
this is true, the onus on community colleges to ensure 
the success of their students demands a concerted 
effort on their part to provide the best possible 
instruction. Inherent in instructional improvement 

is the process of evaluation. 


Many questions concerning the evaluation of 
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instructors in community colleges still remain unanswered. 
Firstly, is it a professional responsibility? That is, 
should faculty members evaluate each other and 
cooperatively seek to improve their instructional 
methods and techniques? A case could easily be made 
for the control, by an organization of professional 
educators, of its own membership. Since much experi- 
mentation in instructional methods and learning strategies 
is still required, would it be better to exclude adminis- 
trators, particularly those involved in college policy 
making and decision making, from evaluative situations 
where the possibility of set-backs, failures, or 
negative findings is ever present? Perhaps evaluation 
of instruction, primarily for the purpose of improving 
instruction, should be carried out by instructors and 
their colleagues, while evaluation of instructors as 
a basis for college decision making should be nae 
exclusively by administrators. Yet, it is difficult 
for a department head to separate the formative 
evaluation of instructors from his other administrative 
duties. 

Secondly, is there much to be gained by de- 
emphasizing the person of the instructor himself and 
instead concentrating on student outcomes, reaching 
objectives, and/or contributing to the theory of 
instruction? It has been suggested that perhaps we 


should forget about evaluating teaching performance 
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and concentrate on other measures of faculty that may 
have more value or significance (Cohen and Brawer, 1969). 
It has also been suggested that until the capabilities 
needed to carry out this function are acquired and 
developed, an over commitment to either total evaluation 
Or no evaluation should be avoided and/or evaluation 
activities slowed 2550 (MacKay, 1971). 

The methods used to evaluate instructors are 
dependent upon many factors such as time, cost, practi- 
cality, evaluator skills, differing educational and 
instructional philosophies, and so on. Although it 
may not be possible to establish a healthy evaluative 
Climate immediately throughout the college, much 
progress may be made by those groups of faculty members 
who are committed to excellence in teaching.and are 
already Striwingito improveiprocedures for evaluating 
the instructional process. Some instructors may 
always resist evaluation of their teaching performance, 
but the majority of new instructors in community 
colleges complain about the lack of guidance and of 
criteria for improving classroom teaching (Lee, 1967). 

RECOMMENDATIONS FOR FURTHER 
RESEARCH AND STUDY 

Experimental studies could be carried out to 
assess the effectiveness of colleagial (peer) evaluation 
and/or student evaluation of instructors, particularly 


new or inexperienced instructors. 
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Student opinionnaires for rating instructors 
and programs could be developed cooperatively by 
Student and faculty members. The use of “performance 
specimens" could be enlightening to instructors. 

In view of the innovative instructional climate 
in many community colleges, studies could be conducted 
to assess student atta due to factors such as a new 
instructional method, a programmed module for learning, 
a behavioral objectives approach to learning, a 
developmental program for disadvantaged students, new 
software for audio-visual media, and so on. 

Criteria for the evaluation of instructor 
competence based on research findings related to 
learning theories and theories of instruction need to 
be developed for use in institutions of higher education. 

In addition to the development of common 
GCriterlavapolicable to all instructors, criteria 
relevant to different instructional situations and 
instructional specialists are urgently needed in 
community colleges, especially in those where instruc- 
tional teams are in operation. 

Studies could be carried out to assess the 
effectiveness of seminars, courses, workshops, and 
laboratory methods for increasing the evaluators' 
skills in assessing instructor competence. 

Evaluative instruments are required to assess 


student gains in the affective domain of learning. 
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Thesesrects Of Gitferent methods of instruction 
and multiple learning strategies could be researched 
using design paradigms which control extraneous variance, 


Maximize systematic variance, and minimize error variance. 
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FACULTY OF EDUCATION 


DEPARTMENT OF EDUCATIONAL 
ADMINISTRATION 


THE UNIVERSITY OF ALBERTA 
EDMONTON 7, CANADA 





January 14, 1972 


Dear Sir: 


I am writing to request your cooperation and assistance and that 
of certain members of your staff in completing a research project. The 
results of this project are to be used at a Community College Workshop 
to be held on May 3lst, June lst, and 2nd at the University of British 
Columbia. A member of your staff will be invited to attend. 


The research is concerned with the factors employed by those 
charged with the responsibility of evaluating and assessing College 
instructors. This project has been approved by Dr. D.A. MacKay, Professor 
in the Department of Educational Administration, Dr. R.C. Bryce, Co-ordinator 
for the Community College Workshop Planning Committee, and Dr. J.E. Seger, 
Director of Research for the Department of Educational Administration. 


I would be most appreciative if you would complete the accompanying 
questionnaire and return it in the enclosed envelope at your earliest 
convenience. Upon receiving your reply, a number of questionnaires will 
be mailed to your College to be filled out by the evaluators of instructors 
in your College. Their individual responses will be treated in the 
strictest confidence. 


I realize that this is an intrusion upon your already busy schedule 
but hope that the results of the project will prove to be of value to your 
College and staff. 


Yours sincerely, 


HUE. Cegpee 


N.C. Cooper 
NCC: pk 
Encl. 
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QUESTIONNAIRE 


Please fill in the following information: 
1. Name of college. 

Ce EL lla a a ee iE ET gee 
2. Number of people involved in evaluating instructors in your 


college. 








3- Name of a staff member who would accept the responsibility for 
distributing the questionnaires to and collecting the completed 
questionnaires from the evaluators in your college, 

4, Primary reasons, in order of importance, for evaluating instruct- 


ors in your college, 


5. Methods used in evaluating instructors in your college. (e.g. classe 
room observation, co-operative evaluation, student evaluation, 
use of check lists, written guidelines, college policies, etc..) 
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Note: 1. Please attach a copy of any printed forms, check lists, 
or guidelines used in the evaluation of instructors in 
your college. 


2. Additional comments or pertinent information would be 
appreciated. Please use the other side of this form, 


‘ 
THANK YOU FOR YOUR CO/OPERATION 
N. C. Cooper 
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THE COLLEGE ADMINISTRATION PROJECT 


SPONSORED BY 
THE W. K. KELLOGG FOUNDATION 


THE UNIVERSITY OF ALBERTA 
EDMONTON 7, CANADA 


FACULTY OF EDUCATION 
DEPARTMENT OF EDUCATIONAL 
ADMINISTRATION 





February 16, 1972 


Dear Sir: 


You recently received a letter and a short questionnaire 
relating to a research study I have undertaken for the Community 
College Workshop Planning Committee. As yet I have had no reply 
from you so I write to ask if you would be kind enough to let me 
have your response as soon as possible. If you have mislaid the 
questionnaire I would be glad to send you another one. 


If you have already forwarded your return please ignore 
this request. 


Yours sincerely, 
WUE bigue 


N.C. Cooper 


P.S. May I, on behalf of Mrs. Cooper, ask for your kind co- 
operation in this study? 


D.A. MacKay ] 
Professor 
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THE UNIVERSITY OF ALBERTA 
EDMONTON 7, CANADA 


FACULTY OF EDUCATION 


DEPARTMENT OF EDUCATIONAL 
ADMINISTRATION 





March 1, 1972 


Dear 


Find enclosed, questionnaires for all members of your staff who 
are directly involved in evaluating instructors in your college. This 
research project is concerned with the factors employed by those charged 
with the responsibility of evaluating and assessing college instructors. 
The results of the study are to be used at a Community College Workshop 
boghbe heldsat tne University of British: Columbia. on June 16 and 1751972. 


I would appreciate it if you would distribute these questionnaires 


and return them in the enclosed envelope as soon after completion as pos- 
sible. 


YOursetruly, 


2 ¢ > oa) 
Z e fi 
ME. Clavier 
NCC: pk 
Enel. 


Thank You For Your Cooperation. 
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INSTRUCTOR EVALUATION QUESTIONNAIRES 


For Evaluators of Community College Instructors 


There are TWO SECTIONS to this Questionnaire: 


SECTION ONE: PERSONAL AND PROFESSIONAL DATA QUESTIONNATRE 
SECTION TWO: EVALUATION OF INSTRUCTORS (TWO QUESTIONNAIRES) 


ie 


You are asked to complete the questionnaires at your earliest convenience. 
Your co-operation will be greatly appreciated. A report on the findings 
will be used at the Community College Workshop to be held on June 16 and 
17, 1972 at the University of British Columbia. 


After you have completed the questionnaires, please feel free to make any 
comments you wish on the evaluation of personnel, or on the study. 


SECTION ONE 
PERSONAL AND PROFESSIONAL DATA QUESTIONNAIRE 


Please complete each of the items below: 


ie 
2. 
oy 


Number of instructors in your college whom you evaluate:............ Ratecetegaue eos 


Your administrative position in the college:..... aii vat soap eee isuereieter ebaetale MA ae ea 


Length of experience in this position (or a comparable one): Check (7) one. 


Pilessethaneo: years 0% «sic. C3) Sm yCATS caiess sa see rie yee 

C25 LO VearSe criss 540 oc (4) *Morerthan) 15) years «tess. = 6 
Your age (nearest birthday): Check (4) one. | 

(Iya UmderaJOnVEALS: «. <2 +s sisters (Aaa GU, Years. srscialernie hence rn 

(2) 30-40 years 2... .5 cts ese ees (s)c0ver 60 years) ...0. soe. oe 


CSP t= SOR VESTS! wos ces cen eines : 


Amount of time you are engaged in classroom teaching: Check (~) one. 
Gh) a NOTE mete teticeis +6) 0\6 00 © 1a el wat eha tea caste erst aUel 


(2) Less, than) 25% of your time.....-.... : 
(3). 25-50% of your time......6+..s iret whateva 
(4) Over 50% of your time........... Taek 


If you are not engaged in teaching, state the year during which you last did 
any classroom teaching......+---++- Rae ie ors . 


Number of years of teaching experience (include teaching at any level and 
count this year if applicable): Check (vy) one. 


(1) Less than 5 years....... ee ta ba eaters 
G25 AMO RV Gar Sires s «ssi sle sie ora Pe ae a MP Ry 
G3) LISP veat sant... s «is Nay Sed Ona Bon aie 


(4) More than 15 years.......... a ea 
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8. 
- A | 
Professional Education Year | Other Degrees and Year 
Degrees Held Obtained Diplomas Held Obtained 
9 e 
SECTION TWO 
EVALUATION OF INSTRUCTORS 
Instructions 
1. Each of the following questionnaires lists 30 factors which may be taken into 
account in evaluating instructors. Please score all items on each questionnaire 
according to, the importance which each factor has for you in your personal 
evaluation of instructors. Use the following scale: 
Please circle your selected response: e.g.: 
(A) indicates a factor always used; 
(F) indicates a factor frequently used; 
(S) indicates a factor seldom used; 
(N) indicates a factor never used. 
Thus your circling of (F) would indicate that the factor concerned 
is used frequently in your evaluation of instructors. 
2. First score all of Questionnaire One, according to the importance which 
each factor has for you when forming opinions about the competence of 
instructors. 
Second, score all of Questionnaire Two, according to the importance which 
each factor has for you when forming opinions that certain instructors 
are worthy of promotion to an administrative position. 
PURPOSE: EVALUATION OF INSTRUCTOR COMPETENCE 
Instructor Evaluation Questionnaire One 
No. Factor 
Peeeesson | preparduLon and (PD LANMLM Ss. sie seis o's dre wie leis tists wi8 8 Sts Yeris eda dan ate A F S N 
2. The personality attributes of the instructor...... Vin tieGe aed, W ieccete teu sila mite A F S N 
3. Concern with the all-round development of the students........... A F S N 
(ene Student Pact Ler pabLon Vin LESSONS a iii ed isle ejea)s 6 bie 6 atsl elie aie 8 Whey dadh a ttt Link F S N 
5. The dress and appearance of the instructor ..... pis alet Womltene te A Ae tee te S N 
6. Examination, results. ..... aL ete leeiube tn raslele Sp aise Castes WR Sae Toile eR SoLLEd Oy ae Us Scie Bilin steele) eek oe LOU ain S N 
deeeinstructor—student relationships.) 2... cies see ee WAP ERE esta Bkie Dative aa gral A F S N 
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Please list below any factor(s) always, frequently, or seldom used by you when 
evaluating instructors as being worthy of promotion to another classroom situation, 


Factor 
Peademrcmtia WrTeartons OL “Che: INSCLUCCOT oes cele siclenwicee ses eens A 
ihesscudenteqwork well) without supervision. .c.icescccawesscvceene A 
CE GSMA ASCUICTUL sis 6,60 sic\s ol o:c's's os so 9 ie Cie Vettatotate vol eet Beata retal areceueaelatshetrus te 2 A 
Theminetructorus hnowledce of the Curriculamsens)c.sssccccescccses A 
The development of the process of individual enquiry in the 
SG eT Crier tersieistelslete ls) ee << )s9 s 0 0 0\ Java teteleeheushe Saat aiaifelia volta bao) 66 is Ale Pe meus 
The enthusiasm displayed by the instructor in teaching....... Miners: uk 
iiempeorcastonamactivities’ Of Che TInStructoOr. wesc sescevecrcsese A 
Concern with character development of the students........... 2 AA 
CHECKIN eeOtewritten, WOK. . oss 0s ses WUatstaapeiete atic SS As SoA RAs aed A 
The degree of Peeducrat ion ‘by the instructor with other staff 
PORTO oT amen E MERU VST ee iy) 51a) ss. 15 oc's ola (le'a areveiate tend este Menon NAUS Ye) trahcl eile ete ere) bie oo A 
The development in students of a sense of community responsi- 
ey) wtala ole statctaiie e's 63 )> ale state tate te veroiat crete agatiate a cie iets RPTeaeraie aieyeieis fare, s siete’s Gly ee 
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The methods of lesson presentation used....... diene ikens Bie iere chara. opet tia. ste A 
Attitude of students toward self-conduct..... D5 ie Ge CRE ee A 
Pemuser OME eaCaihos 1d S 0.5: 2 's.cih-olsaietslojm ahece ears Scnelo sO) IG Paice oA 
Qualities of leadership displayed by the instructor. vattacatate ais _ A 
The students' clarification and recognition of ee ehteseenees sk 
Phewinstructor s standing in the community .\j.0. 0% «ccc. ss piers s cat. 
The degree of self-evaluation of the general teaching 
MGENOGO LORY EUSEG occ. se c's) 00s ele a em ne tere Se oeT Braet! eel a taualate rales tse es Pals te A 
The training of the students in self-expression..............006. A 
Provision made for individual differences........... efens custatatscos eke i A 
Piewinstructoresvstanding with ithe studentsiciy is oc. sels cesses ds 808 A 
iiesetlatudesoratme Students tO: authority. cise civics cs eciccc es » sabres 5 A 


and not included in the above list: 
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PURPOSE: PROMOTION TO AN ADMINISTRATIVE POSITION 
Instructor Evaluation Questionnaire Two 

(A) indicates a factor always used; 

(F) indicates a factor frequently used; 

(S) indicates a factor seldom used; 

(N) indicates a factor never used. 
The dress and appearance of the instructor.......ccecescscas bs tee a A 
Student participation in Lessons. 1.2... ccs eee e ccc cereseenesevece A 
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4. The instructor's knowledge of the curriculum....... Bie) Aine Wey orca | tea Saale | 
5. Class management........... Se eta cet mete NR tema Nears ea cake: ole iatie'e baie eka lsrenayeyetn) Ape RE S N 
6. The development of the process of individual enquiry in the 
SHOE Uae ties aetshaiel cers oh Mastolst slp Rel etenetenaaie Tateliat coavece ters. a palians is (pies atm js ee ests Ayo EF S N 
7. The degree of co-operation by the instructor with other staff 
STNG SN tae Me a a Sip tah ebalbevatene fete ie bares tana tellate rei eustole (ters aie ieteteecerel Nn ah = Ang 
8. Checking of written work. © alin AVC enie Te GEMS RU TATA oeielacs| oat a tatigtarie ea ae roaan Weg 3 S N 
9. The development in pridents: of a sense of ppm te responsi- 
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ie ine, students! ‘clarification and recognition of values............ AUS UA tea yc ey 
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15. The degree of self-evaluation of the general teaching 
methodology used...... Ae iy A Rati 1 SaheraucMaN SPE cae eithe ateneL ets Sires cricjitolcce oie A F S N 
ieeenceversodalioveattributes of the instructor. soe ci st «ess e's se oie's's Arie S N 
17. Concern with the all-round development of the students........... Aye 23 S N 
Pommetessonmpreparation, and planning Wye visk alely ee vie sels viele elsidie sie es Bei Ah 90" F S N 
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20.9 -therstudents work well without supervision... cscs cee ese ce nn Aye ie 5 N 
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23. Concern with the character development of the students........... AN SOtiON 
24. The enthusiasm displayed by the instructor in teaching........... AE Scan 
PPeeeuNeRUcpenGauLlttyrOr (Che InStructoOn ss <:ic chels s sjvis cate le 6)o 56 © prerelease ele eek F S N 
26. Attitude of students toward self-conduct.............. sp soate Aces eee S N 
27. The methods of lesson presentation used...........06. ig sada mebet el ss Furern tetiks a ae S N 
28. The instructor's standing in the community.......... Bistetcnets Wiese erniet, Sunt a" Stee 08 
29. The training of the students in self-expression..... anette is icp ak Tend Sos 
30. Provision made for individual differences........... SRata ee Teapee chews he ei M ape EET S N 
Please list below any factor(s) always, frequently, or seldom used by you when 
evaluating instructors as being worthy of promotion to an administrative position, 
and not included in the above list: 
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THE UNIVERSITY OF ALBERTA 
EDMONTON 7, CANADA 


FACULTY OF EDUCATION 
DEPARTMENT OF EDUCATIONAL 
ADMINISTRATION 


March 29, 1972 


Dear 


You recently received questionnaires for evaluation of 
instructors in your college. These questionnaires will be 
analyzed and used at a Community College Workshop on June 16, 

17, 1972. I would appreciate receiving the completed forms 

at your earliest convenience. If you require additional copies 

I would be happy to supply them. In some cases, I have not 
received the total number specified in the original questionnaire. 


If you have already returned the completed questionnaires 
please disregard the above. 


Thank you 
Wa 
N.C. Cooper 
NCC: ib 
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APPENDIX B 
CRITERIA USED IN THE SECOND INSTRUMENT 


SET OUT IN CATEGORIES 
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CRITERIA INCLUDED AT RANDOM ON THE SECOND INSTRUMENT 


10. 


GROUPED ACCORDING TO MITZEL'S CATEGORIES 


Att nEPRODUCT CRITERIA 


Concern with the all-round development of the 
students. 

Examination results. 

The students work well without supervision. 

The development of the process of individual 
enquiry in the students. 

Concern with the character development of the 
students. 

The development in students of a sense of community 
responsibility. 

Attitude of students toward self-conduct. 

The students' clarification and recognition of 
values. 

The training of the students in self-expression. 


The attitude of students tO authority. 


B. PROCESS CRITERIA 


Lesson preparation and planning. 
Student participation in lessons. 
Instructor-student relationships. 


Class management. 


Eo 



















oT ee 

. 7 . i ’ . 
7 Ls 7 i 5 7 > 
e % Nag Wee wht rate 


ve 


} 
TMEMUATeENT Gudoue SHT WO ‘woumeat TA agausnt saw 7. 
CHTAODATAD | ISSTIM OF onan aZsuORD yee 


AIASTINO TOUMGHE sh. 


oft to tdasmaofsveb bavotbis. ent ritiw nisonod | af 
»eitnebuse | — 

| -adinest potter iniexd +S ae 
soOtatviscgque tuordiw liow x0w adcebose oiT .€ 
fsubivibnt to @as70%g SH 2e jnemqoLsveb oT ob oy 


etnsbite ads at yitepne 
sit to snomqolsyehb 19tos16H9 ea3 dtiw mison0d .é 
“etnobuse 


vj inummos tO sanse 5 io etnebrge io: grigmqoteveb “—, 49 


: wwaitisiesoqaer - 
jor bnoo-ifss Bxswos ainshote Jo ep sttsa .c! : a 
to solainpoosy Bris nbisesitideks Aetaebuse eit 8 aa 
| ,eou Lsv . 7 


MOoLeesigks-ilse mi eynshuse oft 80 poinisss sit .e 
‘ytivodtus 09 2insbite to shesists off .OF 


. a - u o a 
7 ae | we Nee 
aa / ie A c - s 3 





15s 
The enthusiasm displayed by the instructor in 
teaching. 
Checking of written work. 
The methods of lesson presentation used. 
The use of teaching aids. 
The provision made for individual differences. 
The degree of self-evaluation of the general 


teaching methodology used. 
C. PRESAGE CRITERIA 


The personality attributes of the instructor. 

The dress and appearance of the instructor. 

Academic qualifications of the instructor. 

The instructor's knowledge of the curriculum. 

The profegsional activities- of “the: instructor. 

The degree of cooperation by the instructor with 
Other staff members. 

The dependability of the instructor. 

Qualities of leadership displayed by the instructor. 

The instructor's standing in the community. 


The instructor's standing with the students. 
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APPENDIX C 
FACTOR ANALYSIS TO IDENTIFY MITZEL"S 


CATEGORIES OF CRITERIA 
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